Deputy Director of Data Engineering
- DEPARTMENT OF CORRECTION
- Full-time
Location
QUEENS
- No exam required
Department
Information Systems-Admin
Job Description
This vacancy has now expired.
The New York City Department of Correction (DOC) is an integral part of the City’s evolving criminal justice system, participating in reform initiatives and strategies aimed to move the City towards the smallest jail system possible without compromising public safety. The DOC is solely responsible for maintaining a safe and secure environment for staff, visitors, volunteer and people in custody inside our jails. Importantly, safe jails enable DOC to providing people in custody with the tools and opportunities they need to successfully re-enter their communities. The DOC operates facilities and court commands across the five boroughs with over 9,000 diverse professionals and knowledge experts.
The New York City Department of Correction Data Engineering team; designs, builds, manages, and supports a complex and robust data platform that acts as a single unified and trusted data source for all data (structured and unstructured) within the agency. This data is shared with various consumer groups within the agency, as well as with other city departments for analytics, reporting, and decision support. The Deputy Director of Data Engineering provides technical leadership to improve our data solutions and data pipeline architecture, as well as optimizing data flow and data collection for cross-functional teams. The Deputy Director of Data Engineering is not only a manager but a hands-on leader that possesses significant technical skill and expertise in this realm.
Responsibilities will include but are not limited to:
- Design, build, and maintain data models, data warehouses, data lakes, data marts
and reporting/analytics solutions.
- Develop and maintain data integration and data transformation best practices and standards.
- Assemble large, complex sets of data that meet non-functional and functional business requirements.
Help the organization to bring our "one trusted data source" vision to life through a formal enterprise
data lake house.
- Build required infrastructure for optimal extraction, transformation and loading of data from
various data sources (databases, REST, spreadsheets, IoT-enabled Edge Devices, etc.) and
different formats including structured (databases, spreadsheets, delimited files, etc.) and
unstructured (documents, images, videos, etc.) data.
- Design and Implement Data Management and Governance solutions (i.e., Data Warehousing,
Data Lakes, and Reservoirs) in both relational technologies and no-SQL solutions for both
on-prem and cloud deployments
- Manage a team of ETL developers, providing guidance, support, and training as needed.
- Collaborate with stakeholders and various IT groups to implement an overall data strategy
that is in line with business objectives.
- Keep up to date with industry trends and advancements in ETL technologies and tools.
- Perform development and design activities for ETL & Data Integration, Query Optimization
as well as supports UAT process and participate in System Integration testing.
- Develop ETL jobs for data exchanges within the agency databases and data warehouse,
across agencies, vendor data feeds and DOITT open data.
- Provide production support for existing ETL jobs.
- Create technical design documents and mentor Junior ETL Developer(s).
- Contribute to the evolution of the system's architecture and technology, as well as the continual
improvement of development processes. Ensures that defined architecture, coding standards
and best practices are followed.
1. A baccalaureate degree from an accredited college in computer science, information systems, engineering, mathematics or related field and six years of satisfactory full-time experience related to enterprise architecture, solutions architecture, network architecture and/or IT infrastructure systems; or
2. A baccalaureate degree from an accredited college and ten years of satisfactory full-time experience related to enterprise architecture, solutions architecture, network architecture and/or IT infrastructure systems; or
3. Education and/or experience which is equivalent to "1" or "2" above.
- 8+ years of experience in DataStage, Db2 and Microsoft SQL Server is required - Experience in ETL development and data integration solutions using DataStage and other ETL tool such as Kettle, Informatica, etc. - Experience in database design and development using DB2, Microsoft SQL Server, Oracle, and any other RDBMS - Strong knowledge of SQL/T-SQL/PL-SQL, Query Optimization, and Data management skills - Experience in building, managing, and supporting on-prem or cloud-based Big Data platforms - Experience in Cognos 11.x, Tableau & PowerBI would be a plus - Experience with R and Python is a plus - Well Versed in different development methodologies (Iterative, Agile, Scrum etc.) - Self learner with ability to work with new technologies - Strong interpersonal skills and ability to work well in a team - Self-motivated with ability to work with minimal supervision - Experience working as part of a large-scale enterprise IT organization supporting mission critical applications - Excellent problem-solving skills and attention to detail - Ability to interact effectively with stakeholders, technical staff, operations managers, project managers Strong and articulate verbal and written communication skills
New York City Residency is not required for this position
The City of New York is an inclusive equal opportunity employer committed to recruiting and retaining a diverse workforce and providing a work environment that is free from discrimination and harassment based upon any legally protected status or protected characteristic, including but not limited to an individual's sex, race, color, ethnicity, national origin, age, religion, disability, sexual orientation, veteran status, gender identity, or pregnancy.
Job ID
594459
Title code
95711
Civil service title
SENIOR IT ARCHITECT
Title classification
Non-Competitive-5
Business title
Deputy Director of Data Engineering
Posted until
2023-10-25
- Experienced (non-manager)
Job level
00
Number of positions
1
Work location
75-20 Astoria Blvd
- Technology, Data & Innovation