How can I set up log aggregation using ELK with Docker?

How can I set up log aggregation using ELK with Docker?

To set up log aggregation using ELK (Elasticsearch, Logstash, Kibana) with Docker, you can use Docker Compose to define your services.

What should my Docker Compose file look like?

Your Docker Compose file should define services for Elasticsearch, Logstash, and Kibana. Here's a basic example:

version: '3'
services:
  elasticsearch:
    image: elasticsearch:7.10.0
    environment:
      - discovery.type=single-node
    ports:
      - "9200:9200"
  logstash:
    image: logstash:7.10.0
    ports:
      - "5044:5044"
    volumes:
      - ./logstash.conf:/usr/share/logstash/pipeline/logstash.conf
  kibana:
    image: kibana:7.10.0
    ports:
      - "5601:5601"
    depends_on:
      - elasticsearch

How do I configure Logstash to collect logs?

You can configure Logstash by creating a logstash.conf file. Here's a simple example:

input {
  beats {
    port => 5044
  }
}

output {
  elasticsearch {
    hosts => ["elasticsearch:9200"]
    index => "logs-%{+YYYY.MM.dd}"
  }
}

How can I visualize the logs in Kibana?

Once your ELK stack is running, access Kibana at http://localhost:5601. You can create an index pattern for your logs and start visualizing them.