The Office of Technology and Innovation (OTI) oversees all Citywide technology, privacy, cybersecurity, infrastructure, and telecommunications to ensure the security of, and enhance, City operations and service delivery to New York City's residents, businesses, employees, and visitors. As the City's technology and innovation leader, OTI is responsible for operating, maintaining and securing IT infrastructure and systems that touch every aspect of City life from public safety to human services, from education to economic development crossing the full spectrum of governmental operations.

At OTI, we offer great benefits, and the chance to work on projects that have a meaningful impact on millions of people. You'll have the opportunity to work with cutting-edge technology, transition our existing data infrastructure to a cloud-centric platform, and collaborate with other passionate professionals who share your drive and commitment to making a difference through technology.

About New York City Cyber Command
OTI / NYC Cyber Command is charged with protecting all City systems against cyber threats, including systems that deliver vital services to New Yorkers. Headed by the Chief Information Security Officer of the City of New York, we provide in-depth support to over 100 agencies and offices to protect, detect, identify, respond to, and recover from cyber threats.

About the Position
We are seeking a motivated Cyber Senior Data Engineer to join our Data Science Team. Our Data Science Team strives to make security data a strategic asset by providing a platform to structure, manage, integrate, control, analyze, and support threat management activities. As a Cyber Senior Data Engineer, you will help build a secure, scalable, and cloud native data processing framework that will support OTI / Cyber Command's cybersecurity mission.

Responsibilities will include:
- Develop and maintain code utilizing Java, Python and other data processing technologies;
- Interface with cloud APIs such Apache Beam API, GCP Dataflow, GCP Pub/Sub, AWS S3, AWS Kinesis, AWS SQS, Azure LogAnalytics;
- Maintain and manage cloud infrastructure as code using Terraform;
- Identify and implement performance improvements across all subcomponents of data pipeline;
- Work with internal and external teams on maintaining and integrating with other applications and data feeds;
- Support incident management, service-level management, change management, release management, continuity management, and availability management for data management processes/systems;
- Administer integrations to on-prem and cloud-based data stores, databases and/or data management systems that allow for the secure storage, query, protection, and utilization of log data;
- Be part of the Site Reliability team and support on call rotation, participate in environment/network/system health monitoring;

A baccalaureate degree from an accredited college and four years of satisfactory full-time experience related to projects and policies required by the particular position; or,

Education and/or experience which is equivalent to "1" above.

The preferred candidate should possess the following: - Experience with the Agile Development Methodology - Practical knowledge of both Java and Python - Familiarity with Unix scripting, Web development, and automated testing - Familiarity with machine learning techniques and machine learning toolkits such as R, scikit-learn, etc. - Experience working with Terraform - Familiarity with the CI/CD process - At least 3 years’ experience analyzing large, high velocity, heterogeneous datasets - At least 3 years of professional experience with object-oriented/object function scripting languages preferably java or python - Experience working with Terraform - Familiarity with or exposure to cloud application development - Familiarity with distributed data processing frameworks - Self-motivated with a commitment to learning and continuous improvement - Strong team player who can build strong, cross-functional team relationships and collaborate effectively - Ability to document processes, procedures, and design.

As a prospective employee of the City of New York, you may be eligible for federal loan forgiveness programs and state repayment assistance programs. For more information, please visit the U.S. Department of Education’s website at https://studentaid.gov/pslf/

New York City Residency is not required for this position

The City of New York is an inclusive equal opportunity employer committed to recruiting and retaining a diverse workforce and providing a work environment that is free from discrimination and harassment based upon any legally protected status or protected characteristic, including but not limited to an individual's sex, race, color, ethnicity, national origin, age, religion, disability, sexual orientation, veteran status, gender identity, or pregnancy.