Join our forward-thinking team as a Linux Engineer with a strong foundation in Python, where you will play a pivotal role in automating and optimizing our Linux server infrastructure. Our Linux Engineering team is at the heart of our operations, managing the provisioning, configuration, and ongoing performance of an extensive and mission-critical Linux server fleet. In this role, you will leverage cutting-edge automation and self-service tools to ensure our servers are not only stable and reliable but also scalable to meet the demands of a rapidly evolving industry. Your innovative approach and commitment to continuous improvement will help drive us to remain leaders in the field, integrating the latest technologies and methodologies to maintain our competitive edge.
Your Core Responsibilities:
- Use state-of-the-art tools and methods to troubleshoot and resolve complex issues on enterprise Linux systems, ensuring the stability and functionality of our key trading and development systems
- Enhance and support configuration management code and automated processes that operate on 7500+ critical Linux systems in a near 24/7 High-Frequency Trading (HFT), Ultra Low Latency environment
- Apply your Python expertise to design, develop, and support processes that manage and maintain critical Linux systems at scale in a diverse and technically complex environment
- Improve and support existing programs and processes that provision bare-metal servers, transforming them from a blank-slate to fully functioning Linux trading and development platforms
- Support and enhance our metrics and log collection infrastructure, as well as our core monitoring and alerting tools, ensuring robust system visibility
- Consistently communicate status updates, ideas, and strategies with peers and stakeholders through various channels including chats, face-to-face interactions, issue tracking tickets, clear commit messages, and well-documented merge requests
Your Skills and Experience:
- Bachelor’s Degree in Computer Engineering or similar field of study
- 5+ years of experience in Linux engineering, debugging, administration, and OS system provisioning (PXE/DHCP/TFTP/Grub)
- Extensive experience with configuration management at scale, preferably with Puppet and Hiera
- Experience in Docker image building, modification, and publishing
- Hands-on experience with Kubernetes
- Advanced skills in Python for automation, API programming, design, unit testing, and debugging
- Proven experience in designing Ansible tasks and playbooks, as well as utilizing Ansible Tower
- Expertise in RPM design, build, publishing, and repository management
- Familiarity with CI/CD pipelines, version control systems (git), branching and merging best practices
- Proficiency in a range of system/network tools and services including EBPF, tcpdump, strace, nmcli (Network Manager), systemd, ntp/ptp, lsof, nc, nmap and NFS/S3 storage
- Proficiency with networking fundamentals including DNS, TCP/UDP/multicast etc.
- Experience with monitoring tools such as Prometheus/Grafana, Alert Manager, Alerta and OpsGenie