Grafana Mimir Engineer

ATR No Pending Role Title Grafana Backend & Data Optimization Expertise Location UK - The client is flexible Job Description: We are looking for a dynamic and versatile Enterprise Systems Engineer who will be responsible for managing multiple databases, caching solutions, and backend services, with a special focus on Grafana Backend, object storage, and data optimization. The ideal candidate will have a broad understanding of how to manage and optimize large volumes of data, ensuring its efficient storage, transfer, and access. This role extends beyond database management into DevOps, system engineering, and performance optimization, supporting enterprise-scale environments. In this role, the engineer will work with databases, object stores, and caching systems like memcached, and will focus on optimizing both data storage and transfer processes. Experience with logs management, monitoring solutions, and backends for Grafana, especially Mimir, is highly desirable. The ideal candidate should also be skilled in automation, leveraging tools like Chef, scripting languages, and DevOps tools. Key Responsibilities: * Grafana Mimir Backend Management: Set up, configure, and maintain the Grafana Mimir backend for high-performance monitoring and alerting. * Data Optimization: Optimize the storage, movement, and transfer of large datasets across various systems, ensuring efficient resource utilization and performance. * Cache Management: Deploy and manage caching solutions (e.g., memcached) to optimize system performance and response times. * Object Store Optimization: Work with and optimize object stores like Amazon S3, MinIO, or Ceph, ensuring they handle high volumes of data efficiently. * Log Management & Monitoring: Configure logging systems, integrate solutions like Prometheus and Loki, and ensure logs are handled, stored, and monitored effectively. * System Administration: Perform system engineering tasks, particularly on Unix-based systems (preferably Red Hat), including troubleshooting and performance tuning. * Automation: Utilize automation tools (e.g., Chef) and scripting languages (e.g., Python, Ruby, Bash) to automate system and database processes. * DevOps & CI/ CD: Build and manage CI/ CD pipelines using Jenkins, ensuring continuous integration and efficient deployment processes. * Proactive System Monitoring: Monitor database performance, system health, and logs, and implement proactive solutions to maintain system stability and performance. Skill Set: Technical Skills: * Grafana & Mimir: o Experience with configuring and managing Grafana Mimir backends and data sources. o Expertise in setting up dashboards and monitoring solutions for enterprise-scale applications. * Database & Data Management: o Manage multiple databases: SQL (PostgreSQL, MySQL), NoSQL (MongoDB, Cassandra). o Expertise in data optimization, ensuring that databases and storage solutions can handle large datasets effectively. * Caching Solutions: o Experience with memcached or similar caching technologies for improving data retrieval times and overall system performance. * Object Store Management & Optimization: o Optimize object storage systems such as Amazon S3, MinIO, or Ceph for high performance and efficient data storage. * Log Management: o Expertise in handling logs using tools like Prometheus, Loki, and ELK Stack for managing large volumes of logs and providing real-time insights. * Unix/ Linux System Administration: o Expertise in managing Red Hat Enterprise Linux or other Unix-based systems, including system performance tuning and service management. * Automation & Scripting: o Proficiency in automation using Chef or similar tools. o Strong scripting skills in Bash, Python, Ruby for system and data process automation. * DevOps & CI/ CD Pipelines: o Deep understanding of DevOps tools and processes, including managing Jenkins pipelines, and integrating code delivery solutions. * Hadoop o Experience with administrating Hadoop stack o Expertise in handling Hadoop components such as Hive, Impala, Kafka Soft Skills: * Proactivity: Ability to anticipate challenges, implement preventative solutions, and take initiative in an enterprise environment. * Analytical Thinking: Strong problem-solving skills, particularly with complex data management and optimization challenges. * Collaboration: Excellent teamwork skills, able to collaborate across multiple teams (IT, DevOps, Database Admins, Developers). * Communication: Strong ability to convey technical concepts to both technical and non-technical stakeholders. * Adaptability: Flexible and able to thrive in a fast-paced, enterprise environment with shifting priorities. Tools & Technologies: Databases & Object Stores: * SQL Databases: PostgreSQL, MySQL, MariaDB, InfluxDB * NoSQL Databases: MongoDB, Cassandra, Redis * Object Stores: Amazon S3, MinIO, Ceph Backend Tools & Services: * Grafana Mimir (backend for monitoring and alerting) * Prometheus (for monitoring) * Loki (for logging) Caching: * Memcached * Nginx Operating Systems & Automation: * Linux/ Unix (Red Hat preferred) * Chef (for automation and configuration management) * Scripting Languages: Bash, Python, Ruby DevOps Tools: * Jenkins (for CI/ CD pipeline management) * Git (for version control) * Infrastructure as Code (Terraform, Ansible) Monitoring & Logging: * Grafana, Prometheus, Loki Qualifications: * Experience: 5+ years in systems engineering, backend infrastructure, or DevOps roles, with experience handling databases, object stores, and caching systems. * Education: Bachelor's degree in Computer Science, Information Systems, or related field, or equivalent practical experience. LA International is a HMG approved ICT Recruitment and Project Solutions Consultancy, operating globally from the largest single site in the UK as an IT Consultancy or as an Employment Business & Agency depending upon the precise nature of the work, for security cleared jobs or non-clearance vacancies, LA International welcome applications from all sections of the community and from people with diverse experience and backgrounds. Award Winning LA International, winner of the Recruiter Awards for Excellence, Best IT Recruitment Company, Best Public Sector Recruitment Company and overall Gold Award winner, has now secured the most prestigious business award that any business can receive, The Queens Award for Enterprise: International Trade, for the second consecutive period.