You can pay EPF without paying social security

Only pay provident fund without social security is not allowed. If an employer does not apply for social insurance registration, the social insurance administrative department shall order it to make corrections within a certain period of time; if it fails to do so, it shall impose a fine. The employer shall apply for social insurance registration for its employees with the social insurance agency within thirty days from the date of employment.

Article 12 of the Social Insurance Law

The employer shall pay the basic pension insurance premiums in accordance with the proportion of the total wages of the employees of the unit as stipulated by the State, and credit them to the Basic Pension Insurance Co-ordination Fund.

Employees shall pay basic pension insurance premiums in the proportion of their own wages as prescribed by the State, which shall be credited to their individual accounts.

Individual industrial and commercial households without employees, part-time workers who have not participated in basic pension insurance with their employers, and other flexibly employed persons participating in basic pension insurance shall pay basic pension insurance premiums in accordance with the state regulations, which shall be credited to the basic pension insurance general fund and the individual account respectively.