Senior Software Engineer

Job Description :

Responsibilities :

- Deep dive into popular open-source repositories to analyze and triage GitHub issues.

- Set up and configure complex development environments, including Docker and various tooling, to facilitate seamless repository interaction.

- Rigorously evaluate unit test coverage, execution, and overall code quality of diverse open-source projects.

- Modify and execute open-source projects locally to accurately test and benchmark LLM-based bug-fixing performance and other coding capabilities.

- Collaborate closely with our research teams to identify challenging and impactful repositories for LLM evaluation.

- (Optional, but encouraged) Take on leadership responsibilities, mentoring junior engineers and contributing to the design and execution of large-scale LLM research projects.

What We're Looking For (Must-Have Requirements) :

- Minimum of 3+ years of professional software engineering experience.

- Mandatory : Proven, significant contributions to GitHub repositories with 5,000+ stars. Please include links to your relevant contributions in your application.

- Hands-on expertise with at least one of the following programming languages : Python, JavaScript, Java, Go, Rust, C, C++, C#, Ruby.

- Solid knowledge and practical experience with Git, Docker, and setting up robust development pipelines.

- Comfortable navigating, understanding, and working within complex open-source codebases.

- Demonstrated ability to run, test, and modify production-grade open-source projects locally.

Nice to Have (Bonus Points) :

- Prior experience participating in LLM evaluation, AI/ML research, or related fields.

- Experience working on developer tools or automation agents.

- A proactive approach to mentoring or leading a small engineering team.