[Kafka] Add system tests for the datasets

[agithomas]

• Enhancement

Proposed commit message

Add system tests for the datasets

Checklist

• I have reviewed tips for building integrations and this pull request is aligned with them.
• I have verified that all data streams collect metrics or logs.
• I have added an entry to my package's changelog.yml file.
• I have verified that Kibana version constraints are current according to guidelines.
• I have verified that any added dashboard complies with Kibana's Dashboard good practices

Author's Checklist

• Package upgrade tests

How to test this PR locally

• elastic-package build && elastic-package stack up -v -d --services package-registry

[elastic-vault-github-plugin-prod]

🚀 Benchmarks report

To see the full report comment with /test benchmark fullreport

[elasticmachine]

💚 Build Succeeded

• Buildkite Build
• Commit: d193804

History

• 💚 Build #31167 succeeded 0beef8a
• 💚 Build #31105 succeeded f165415
• 💚 Build #31100 succeeded 5e70dc6
• 💚 Build #30997 succeeded b1f42b4

[elastic-sonarqube]

Quality Gate passed

Issues
0 New issues
0 Fixed issues
0 Accepted issues

Measures
0 Security Hotspots
100.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube

[muthu-mps]

@agithomas - Can you confirm we are able to generate sample-events by running the system tests? If possible, we could even overwrite the files which is already generated. WDYT?

[agithomas]

@agithomas - Can you confirm we are able to generate sample-events by running the system tests? If possible, we could even overwrite the files which is already generated. WDYT?

All the existing sample events present under the datasets were automatically generated. It is just that i have created a separate PR for adding the configs present in this PR.

[elastic-vault-github-plugin-prod]

Package kafka - 1.22.0 containing this change is available at https://epr.elastic.co/package/kafka/1.22.0/