Accountability, or the lack of it, in governance generally, and civil services, in particular, is a major factor underlying the deficiencies in governance and public administration. Designing an effective framework for accountability has been a key element of the reform agenda. A fundamental issue is whether civil services should be accountable to the political executive of the day or to society at large. In other words, how should internal and external accountability be reconciled? Internal accountability is sought to be achieved by internal performance monitoring, official supervision by bodies like the Central Vigilance Commission and Comptroller and Auditor General, and judicial review of executive decisions. Articles 311 and 312 of the Indian Constitution provide job security and safeguards to the civil services, especially the All India Services.The framers of the Constitution had envisaged that provision of these safeguards would result in a civil service that is not totally subservient to the political executive but will have the strength to function in larger public interest. The need to balance internal and external accountability is thus built into the Constitution. The issue is where to draw the line. Over the years, the emphasis seems to have tilted in favour of greater internal accountability of the civil services at large through the election process. This system for seeking accountability to society has not worked out and has led to several adverse consequences for governance. Some special measures can be considered for improving accountability in civil services. Provisions of Articles 311 and 312 should be reviewed, and laws and regulations framed to ensure external accountability of civil services. The proposed Civil Services Bill seeks to address some of these requirements. The respective roles of professional civil services and the political executive should be defined so that professional managerial functions and management of civil services are depoliticized. For this purpose, effective statutory civil service boards should be created at the centre and in the states. Decentralization and devolution of authority to bring government and decision-making closer to the people also help to enhance accountability.