Data transforms the traditional nature of production factors and serves as a high-caliber production factor for the development of new quality productive forces. As an important part of data, public data is a foundational resource and key variable for cultivating and expanding new quality productive forces. Under the background of the increasingly strategic development of new quality productive forces, public data plays a vital role in developing industrial forms, accelerating technological innovation, and improving government efficiency. In practice, China has achieved remarkable results in public data governance, but the phenomena of public data being “difficult to circulate”, “hard to supply”, and “poorly utilized” still exist objectively. The reason behind this is not the failure of a single link in public data governance, but rather the legal obstacles in multiple fields such as the concept of public data governance, local governance of public data, and authorized management of public data. While profoundly grasping the essential characteristics of public data elements, to improve the level of sound law-based governance in public data governance, it is necessary to follow and respond actively to the inherent legal system attributes of public data governance, such as “orderliness”, “openness”, and “the rule of law”. On this basis, enhancing the efficiency of public data governance requires improving TFP in multiple ways, and realizing the upgrade of public data governance by reconstructing the relationship between laborers, labor tools, and objects of labor in data governance. This paper specifically focuses on key elements within the governance system, such as “rights”, “capabilities”, “mechanisms”, “scenarios”, “order”, and “talents”, and forms a systematic legal path including the coordination of public data governance mechanisms, rights allocation, digital empowerment, scenario innovation, value embedding, and talent support, so as to realize the “accessibility”, “availability”, “affordability”, and “sustainability” of public data, injecting new legal momentum and vitality into the sustainable development of China’s new quality productive forces.