By labor charges, if you mean wages paid to casual labor engaged during the course of business, you are expected to pay contributions, both ESI and EPF, on the same. This is because an employee means any person, whether on the payroll or not, employed for the work connected with the operations of the company. At the same time, labor engaged for work not connected with the company's operations, such as the construction of a compound wall, may be excluded. Different views have been expressed by authorities and courts from time to time on this matter.
In my opinion, ESI is stricter in such compliance, and EPFO tends to overlook it.
Regards, Madhu.T.K