4

Logs are Now Part of the APM Experience | New Relic

 2 years ago
source link: https://newrelic.com/blog/nerdlog/apm-logs-in-context
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
APM

View logs in context of APM data without any manual configuration

With your next APM agent upgrade, view application logs in context of APM metrics with granular configurations tailored for your billing and security needs. Opt out anytime.

Published May 3, 2022 • 4 min read

Accessing application logs in the context of APM metrics has consistently been one of our most requested capabilities because it’s critical for efficiently troubleshooting performance issues. However, until now, developers have had to manually request access to specific hosts and configure non-standard log forwarding to collect application logs separate from their APM metrics, traces, and events.

To address this developer pain point, when you update to our newest Java, .NET, and Ruby APM language agents you will automatically start collecting logs without the need to set up or configure anything, with granular configurations tailored for your billing and security needs with the option to opt-out anytime.

Starting May 3rd, 2022, you get the following three key benefits when you update to these new APM agents: 

  • Eliminate manual log configuration and maintenance necessary to collect and forward logs to New Relic when using Java, .NET, and Ruby APM agents.
  • Minimize context-switching by viewing application logs in context with APM metrics, traces, and events.
  • Troubleshoot issues faster by accessing logs inside the APM with enhanced UI that help you troubleshoot issues faster.

When collecting logs, it is critical to ensure security, compliance, and control. This is why we are including robust support for the following: 

  • Opt-out anytime: Turn off automatic forwarding at any point by configuring your agent or using New Relic’s data management hub
  • Ingest control: Use in-agent log sampling to manage ingested volume and avoid duplicating ingest and get 3X more value than alternate log management solutions. 
  • Compliance: Log collection is disabled by default for HIPAA, PCI-enabled accounts, and accounts where High Security Mode is in use, even after you upgrade the agent. 
  • Data security: Mask, obfuscate, and prevent sending PII, PHI, or any other sensitive data via customizable security configurations

Note: Application logs in APM are only available after an APM agent update. Until you upgrade, you will see no changes in your account.

Automatic logs in context help users troubleshoot applications faster.

Let’s find out more about these new features.

Collecting logs via APM Agent

Logs are an integral part of troubleshooting application performance and health, but collecting application logs is a complex and often frustrating experience that requires domain expertise and access to your underlying environment.

Now, when you upgrade your APM agents (for supported application languages), they will automatically collect and forward logs to New Relic by default, without the need to set up or configure anything. No more need for container sidecars or third-party applications1. In a single deployment, users can automatically monitor both applications and logs.

The following languages and frameworks are supported with this release:

Java .NET Ruby
Log4j2 Log4net Ruby standard library logger
Logback Serilog  
  Microsoft.Extensions.Logging  

Learn more about the APM agent log configuration.

View application logs in context

Logs are better with context. By adding metadata to your logs, New Relic provides context that links your telemetry event types and entities—like APM—across our platform. Having application context in a log means that you can see all logs related to an application in a single view. You can troubleshoot and analyze your data without the need to switch between screens or tools.

Hosts (infrastructure) view experience now links to available logs.

Enhanced UI provides logs where you need them

We’ve improved our user interface to surface the logs you need alongside other relevant telemetry data. You get detailed logs across the New Relic platform, including errors inbox, application traces, and more. By combining APM and log data seamlessly, it's easier than ever to troubleshoot and identify the root cause of issues.

Updated errors inbox gives you access to the log data for each error instance.

Ensuring data privacy by managing your logs

Data collection always carries the risk of inadvertent sensitive data disclosure. Logs can contain sensitive data that should not leave your environment, regardless of how you’re sending those logs.  You always have direct control over your systems and which data you send to New Relic. Be sure to follow your organization's security guidelines to mask, obfuscate, or prevent sending PII, PHI, or any other sensitive data.

For more information, see our security documentation for log management.

Opting out and turning automatic log forwarding off

You may not want to ingest logs based on your organization’s security guidelines or to control costs. You can turn off logs by configuring your agent config file locally, or you can disable it at the account level in New Relic’s data management hub.

APM agent log ingestion is disabled by default at the account level for HIPAA, PCI-enabled accounts, and accounts where High Security Mode is in use, even after you upgrade the agent.

You can also enable log ingest from APM agents at any time by using the self-service toggle in the New Relic data management UI. Learn more about how to toggle log ingestion on or off.

Get started with application logs in context

To begin using automatic logs in context, log in to your New Relic account or sign up for a free account today and make sure you are using the latest APM Java agent v7.7.0 or higher, Ruby agent v8.7.0 or higher, and .NET agent v9.7.2.0 or higher and start using the power of automatic logs in context. Your free account offers 100 GB/month of data ingest, one full-platform user, and unlimited basic users.

1 Third-party log forwarders might be required in special circumstances.


Julian Giuca is a Senior Director of Product leading the strategy and execution of New Relic Logs and NRDB. Julian has worn many hats at New Relic: as a Rails engineer focused on account and subscription management, as a principal engineer on the company’s first R&D team, and lastly as a product manager. During his time in R&D, the vision for New Relic Logs was born and Julian’s passion for product management and logs came to life.

The views expressed on this blog are those of the author and do not necessarily reflect the views of New Relic. Any solutions offered by the author are environment-specific and not part of the commercial solutions or support offered by New Relic. Please join us exclusively at the Explorers Hub (discuss.newrelic.com) for questions and support related to this blog post. This blog may contain links to content on third-party sites. By providing such links, New Relic does not adopt, guarantee, approve or endorse the information, views or products available on such sites.


About Joyk


Aggregate valuable and interesting links.
Joyk means Joy of geeK