Abstract: We consider a system of semi-linear partial differential equations with measurable coefficients and a nonlinear Neumann boundary condition. We construct a sequence of penalized partial differential equations which converges to a solution of the initial problem. Our approach is based on the theory of backward stochastic differential equations.