gallery.technet.microsoft.com€¦ · web viewc:\program files\microsoft monitoring...

23
Creation of subscription on Azure Create a login on Portal.Azure.com Sign-in with your name create some log analytics and copy the subscription IF YOU HAVE A PROXY SERVER: REGISTRATION / CONFIGURATION STEPS Depending on your proxy configuration, you might not be able to register at all. Also, even if you do manage to register, some communication from SCOM to the service will later fail and scenarios might not light up in the portal. The protocols and endpoints needed to allow management servers, the console and direct agents to communicate in order for OpInsights to work are listed below. Step 1: Request exception for the service endpoints

Upload: others

Post on 28-May-2020

24 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: gallery.technet.microsoft.com€¦ · Web viewC:\Program Files\Microsoft Monitoring Agent\Agent\Health Service State\Management Packs Procedure 3: Validate if data is being sent up

Creation of subscription on Azure

Create a login on Portal.Azure.com

Sign-in with your name create some log analytics and copy the subscription

IF YOU HAVE A PROXY SERVER: REGISTRATION / CONFIGURATION STEPS

Depending on your proxy configuration, you might not be able to register at all. Also, even if you do manage to register, some communication from SCOM to the service will later fail and scenarios might not light up in the portal. The protocols and endpoints needed to allow management servers, the console and direct agents to communicate in order for OpInsights to work are listed below.

Step 1: Request exception for the service endpoints

The following domains and URLs need to be accessible through the firewall/proxy for the management server to access the Azure Operational Insights Web Services:

Management Server

URL Portsservice.systemcenteradvisor.com Port 443

Page 2: gallery.technet.microsoft.com€¦ · Web viewC:\Program Files\Microsoft Monitoring Agent\Agent\Health Service State\Management Packs Procedure 3: Validate if data is being sent up

scadvisor.accesscontrol.windows.net

scadvisorservice.accesscontrol.windows.net

*.blob.core.windows.net/*

data.systemcenteradvisor.com

ods.systemcenteradvisor.com*.ods.opinsights.azure.com

*.systemcenteradvisor.com

Port 443

Port 443

Port 443

Port 443

Port 443

Port 443

Port 443

 

Large Volume scenarios / intelligence packs and OpsMgr agents

Note that with some intelligence packs (now called Solutions), given the large volume of data sent in those scenarios, the agents, even if reporting to OpsMgr and receiving configuration from the OpsMgr Management Group, will report data directly without queuing thru the management server to the cloud. A good example of this is the Security and Audit solution. The URL and port needed for this communication is as follows:

URL Ports*.ods.opinsights.azure.com Port 443 Note that the proxy setting specified in Step 2 below will be automatically propagated to OpsMgr agents.

Operations Manager console

The following domains and URLs need to be accessible through the firewall to view the Advisor Web portal and the OpsMgr console (to perform ‘registration’ to Azure Operational Insights).

Resource 

Ports 

*.systemcenteradvisor.com*.live.com

*.microsoft.com

*.microsoftonline.com

Ports 80 and 443Ports 80 and 443

Ports 80 and 443

Ports 80 and 443

Page 3: gallery.technet.microsoft.com€¦ · Web viewC:\Program Files\Microsoft Monitoring Agent\Agent\Health Service State\Management Packs Procedure 3: Validate if data is being sent up

login.windows.net Ports 80 and 443

 

Also ensure the Internet Explorer proxy is set correctly on the computer you are trying to login with. It is especially valuable to test connecting to a SSL enabled website (e.g. https://www.bing.com/). If the HTTPS connection doesn’t work from a browser, it probably also won’t work in the Operations Manager console and in the server modules that talk to the web services in the cloud. Directly-connected AgentsDirect Agents do not us your credentials to connect to the workspace: you have to enter workspace ID and key. Those credentials are used for registration, and after the agent is registered a certificate is used. Direct Agents only need to connect to the following destinationsURL Ports*.blob.core.windows.net/**.oms.opinsights.azure.com*.ods.opinsights.azure.comods.systemcenteradvisor.com

Port 443Port 443

Port 443

Port 443

 

Once you have completed registering your OpsMgr environment to the Advisor Service, you must follow Steps 2, 3 and 4 below to allow your Management Servers to send data to the Advisor Web Service.

Step 2: Configure the proxy server in the OpsMgr console

Open the OpsMgr Console. Go to the “Administration” view. Select “Advisor Connection” under the “System Center Advisor”

node.

Page 4: gallery.technet.microsoft.com€¦ · Web viewC:\Program Files\Microsoft Monitoring Agent\Agent\Health Service State\Management Packs Procedure 3: Validate if data is being sent up

Check the checkbox to use a proxy server to access the Advisor Web Service.

Specify the proxy address in the http://proxyserver:port format.

Page 5: gallery.technet.microsoft.com€¦ · Web viewC:\Program Files\Microsoft Monitoring Agent\Agent\Health Service State\Management Packs Procedure 3: Validate if data is being sent up

 Step 3: Specify credentials for OpsMgr if the proxy server requires authenticationIf your proxy server requires authentication, you can specify one in the form of an OpsMgr RunAs account and associate it with the ‘System Center Advisor Run As Profile Proxy’:

In the OpsMgr Console, go to the “Administration” view. Select “Profiles” under the “RunAs Configuration” Node. Double click and open “System Center Advisor Run As Profile

Proxy”:

Page 6: gallery.technet.microsoft.com€¦ · Web viewC:\Program Files\Microsoft Monitoring Agent\Agent\Health Service State\Management Packs Procedure 3: Validate if data is being sent up

 

Click ‘Add’ to add a ‘RunAs Account‘. You can either create one or use an existing account. This account needs to have sufficient permissions to pass through the proxy.

Set the Account to be targeted at the ‘Operations Manager Management Servers’ Group.

Complete the wizard and save the changes:

Page 7: gallery.technet.microsoft.com€¦ · Web viewC:\Program Files\Microsoft Monitoring Agent\Agent\Health Service State\Management Packs Procedure 3: Validate if data is being sent up

Note: Not all code paths currently support authentication. It is still possible that you will need to set some of those exclusions mentioned in Step 1 to allow anonymous traffic to some of those destinations. We will keep this document up-to-date as this requirement evolves.

 Step 4: Configure the proxy server on each OpsMgr Management Server for managed codeThere is another setting in Operations Manager which is intended for general error reporting, but we have noticed that when this is set it also ends up affecting Advisor connector’s functionality. This is because the same modules are being used in multiple workflows. The recommendation is therefore to also set it to the same proxy you set in the other places for each and every management server if you use a proxy.

In the OpsMgr Console, go to the “Administration” view. Select “Device Management” and then the “Management

Servers” node. Right-click and choose “Properties” for each MS (one at the time) and

set the proxy in the “Proxy Settings” tab:

c

Note:**Configuring Advisory is not manadatory.

Page 8: gallery.technet.microsoft.com€¦ · Web viewC:\Program Files\Microsoft Monitoring Agent\Agent\Health Service State\Management Packs Procedure 3: Validate if data is being sent up

VERIFYING IF THINGS ARE WORKING POST REGISTRATIONProcedure 1: Validate that the right Management Packs get downloaded to your OpsMgr EnvironmentNote: Depending on which Solutions you have enabled from the Operational Insights portal, you may see more listed or less. Search for the keyword ‘Advisor’ or ‘Intelligence’ in their name.

You can additionally check for these MPs using these PowerShell commands:get-scommanagementpack | where {$_.DisplayName -match ‘Advisor’} | select Name,DisplayName,Version,KeyToken

get-scommanagementpack | where {$_.DisplayName -match ‘Advisor’} | select Name,DisplayName,Version,KeyToken | Out-GridView

Note: If you are troubleshooting Capacity, check HOW MANY management packs with the name containing ‘capacity’ you have. There are two management packs that have the same display name (but different internal ID’s) that come in the same MP bundle. If one of the two does not get imported (often due to a missing VMM dependency) the other MP does not get imported and the operation does not retry.

You should see the following three MPs related to ‘capacity’

Microsoft System Center Advisor Capacity Intelligence Pack Microsoft System Center Advisor Capacity Intelligence Pack

Page 9: gallery.technet.microsoft.com€¦ · Web viewC:\Program Files\Microsoft Monitoring Agent\Agent\Health Service State\Management Packs Procedure 3: Validate if data is being sent up

Microsoft System Center Advisor Capacity Storage Data

If you only see one or two of them but not all three, remove it and wait 5 to 10 minutes for OpsMgr to download and import them again. Check the event logs for errors during this time.

Procedure 2: Validate if the right Intelligence Packs get downloaded to your Direct AgentIn Direct Agent mode you should see the Intelligence Packs collection policy being cached under C:\Program Files\Microsoft Monitoring Agent\Agent\Health Service State\Management Packs

Procedure 3: Validate if data is being sent up to the Advisor service (or at last attempted)

Open ‘Performance Monitor’. Select ‘Health Service Management Groups’. Add all the counters that start with ‘HTTP’:

Page 10: gallery.technet.microsoft.com€¦ · Web viewC:\Program Files\Microsoft Monitoring Agent\Agent\Health Service State\Management Packs Procedure 3: Validate if data is being sent up

If things are configured correctly, you should see activity for these counters as events and other data items (based on the intelligence packs onboarded in the portal and the configured log collection policy) are uploaded. Those counters don’t necessarily have to be continuously ‘busy’, but if you see little to no activity it might be that you are not onboarded on many Solutions or have a very lightweight collection policy.

Page 11: gallery.technet.microsoft.com€¦ · Web viewC:\Program Files\Microsoft Monitoring Agent\Agent\Health Service State\Management Packs Procedure 3: Validate if data is being sent up

Procedure 4: Check for errors on the Management Server or Direct Agent event logs As a final step, if all of the above fails see if you have any errors in Event Viewer –> Application and Services –> Operations Manager event log. Filter by Event Sources: Advisor, Health Service Modules, HealthService and Service Connector (this last one applies to Direct Agent only). You can copy these event and post them in the ‘Feedback’ forum so we on the product team can help you further. Most of these events would be also be found on Direct Agent and the troubleshooting steps would be similar. The only part that differs between SCOM and Direct Agent is really the registration process:

In Operations Manager you have a nice wizard with browser integration that lets you pick your workspace as a user/admin, then SCOM takes care of exchanging certificates and uses those for MP download and data transfer/upload to OpInsights.

In Direct Agent, you just copy/paste the workspace ID and key, and those are used to authenticate that it’s really you registering those agents and that you own that workspace, then certificates are exchanged under the hood by the service similarly to SCOM and used the same way.

Page 12: gallery.technet.microsoft.com€¦ · Web viewC:\Program Files\Microsoft Monitoring Agent\Agent\Health Service State\Management Packs Procedure 3: Validate if data is being sent up

Because of this, many of these events apply to both types of reporting infrastructure.Open Event Viewer –> ‘Application and Services’ –> ‘Operations Manager’ and filter by Event Sources: Advisor, Health Service Modules, HealthService and Service Connector (this last one applies to Direct Agent only).

Here are a few of the ‘bad’ events you might see if things aren’t working the way they should:

EventID

Source Meaning Resolution

2138 Health Service Modules

Proxy requires authentication Follow step 3 and/or step 1 above

2137 Health Service Modules

Cannot read the authentication certificate

Re-running the Advisor registration wizard will fix certificates/runas accounts

2132 Health Service Modules

Not Authorized Could be an issue with the certificate and/or registration to the service; try re-running the Advisor registration wizard that will fix certificates and runas accounts. Additionally, verify the proxy has been set to allow exclusions as in step 1 above, and/or verify authentication as in step 3 (and that the user indeed has access thru the proxy)

2129 Health Service Modules

Failed connection / Failed SSL negotiation

There could be some strange TCP settings on this server. Check this other blog post from the community for such as case http://jacobbenson.com/?p=511

2127 Health Service Modules

Failure sending data received error code

If it only happens once in a while, this could be just a glitch. Keep an eye to understand how often it happens. If very often (every 10 minutes or so throughout the day), then it is an issue – check your network configuration, proxy settings described above, and re-run registration wizard. But if it only happens sporadically (i.e. a couple of times per day) then everything should be fine, as data will be queued and retransmitted.Some of the HTTP error codes have some special meanings, i.e.:– the FIRST time that a MMA direct agent or management server tries to send data to our service, it will get a 500 error with an inner 404

Page 13: gallery.technet.microsoft.com€¦ · Web viewC:\Program Files\Microsoft Monitoring Agent\Agent\Health Service State\Management Packs Procedure 3: Validate if data is being sent up

error code – 404 means not found; this indicates that the storage area we’ll use for this new workspace of yours isn’t quite ready yet – it is being provisioned. On next retry, this will however be ready and flow will start working (under normal conditions).A 403 might indicate a permission/credential issue, and so forth. There are more information on the 403 below in the Direct agent specific section of this post.

2128 Health Service Modules

DNS name resolution failed You server can’t resolve our internet address it is supposed to send data to. This might be DNS resolver settings on your machine, incorrect proxy settings, or a (temporary) issue with DNS at your provider. Like the previous event, depending if it happens constantly or ‘once in a while’ it could be an issue – or not.

2130 Health Service Modules

Time out Like the previous event, depending if it happens constantly or ‘once in a while’ it could be an issue – or not.

4511 HealthService

Cannot load module “System.PublishDataToEndPoint” – file not found

Initialization of a module of type “System.PublishDataToEndPoint” (CLSID “{D407D659-65E4-4476-BF40-924E56841465}”) failed with error code system cannot find the file specified. This error indicates you have old DLLs on your machine, that don’t contain the required modules. The fix is to update your Management Servers to the latest Update Rollup.

4502 HealthService

Module crashed If you see this for workflows with names such as CollectInstanceSpace or CollectTypeSpace it might mean the server is having issues to send some data. Depending on how often it happens – constantly or ‘once in a while’ – it could be an issue or not. If it happens more that every hour it is definitely an issue. If only fails this operation once or twice per day, it will be fine an able to recover. Depending on how the module actually fails (description will have more details) this could be an on-premises issue – i.e. to collect to DB – or an issue sending to the cloud. Verify your network and proxy settings, and worst case try restarting the HealthService.

4501 HealthService

Module “System.PublishDataToEndPoint”  crashed

A module of type “System.PublishDataToEndPoint” reported an error 87L which was running as part of rule “Microsoft.SystemCenter.CollectAlertChangeDataToCloud” running for instance “Operations Manager Management Group” with id:”{6B1D1BE8-EBB4-

Page 14: gallery.technet.microsoft.com€¦ · Web viewC:\Program Files\Microsoft Monitoring Agent\Agent\Health Service State\Management Packs Procedure 3: Validate if data is being sent up

B425-08DC-2385C5930B04}” in management group “SCOMTEST”.You should NOT see this with this exact workflow, module and error anymore, it used to be a bug *now fixed* tracked here http://feedback.azure.com/forums/267889-azure-operational-insights/suggestions/6714689-alert-management-intelligence-pack-not-sending-ale

4002 Service Connector

The service returned HTTP status code 403 in response to a query.  Please check with the service administrator for the health of the service. The query will be retried later.

You can get a 403 during the agent’s initial registration phase, you’ll se a URL likehttps://<YourWorkspaceID>.oms.opinsights.azure.com/ AgentService.svc/AgentTopologyRequestError code 403 means ‘forbidden’ – this is typically a wrongly-copied WorkspaceId or key, or the clock is not synced (just like for ‘error 3000’ in SCOM at the beginning of this article) – see more here

Procedure 5: Look for your agents to send their data and have it indexed in the portalCheck in the Operational Insights portal to see if your clients are reporting in. From the Overview page, navigate to the large blue SETTINGS tile – it will be either the first or last tile depending on your configuration state. In SETTINGS, click the CONNECTED SOURCES tab. Each column on this page represents a different data source type attached (servers attached directly, OpsMgr management groups and Azure storage accounts). Clicking the blue “X servers/mgmt groups/storage accounts connected” will bring you to a search with more detail. On this page you will also see a list of individual management groups connected. Clicking one of these management groups will also bring you to a search and show you a list of the servers connected to this management group.NOTE: If a data source is listed as reporting on this page, it does not necessarily mean we have collected any data from the source. In this case it’s possible that drilling into search from this page will show inconsistent results (e.g. you’ll see a data source listed in CONNNECTED SOURCES, but it won’t be in search). Once data collection has started, either from an IP or from log collection, the results in search will be consistent.

Page 15: gallery.technet.microsoft.com€¦ · Web viewC:\Program Files\Microsoft Monitoring Agent\Agent\Health Service State\Management Packs Procedure 3: Validate if data is being sent up

Once Advisor is set, its time for OMS

Click on

You will be prompted for OMS suite login page

Page 16: gallery.technet.microsoft.com€¦ · Web viewC:\Program Files\Microsoft Monitoring Agent\Agent\Health Service State\Management Packs Procedure 3: Validate if data is being sent up

You can now see the workspaces available to monitor

Page 17: gallery.technet.microsoft.com€¦ · Web viewC:\Program Files\Microsoft Monitoring Agent\Agent\Health Service State\Management Packs Procedure 3: Validate if data is being sent up

Click on create

Page 18: gallery.technet.microsoft.com€¦ · Web viewC:\Program Files\Microsoft Monitoring Agent\Agent\Health Service State\Management Packs Procedure 3: Validate if data is being sent up

Click on close

Now when we go back to OMS->connector screen appears as below

Under actions click on Add a computer/Group

Page 19: gallery.technet.microsoft.com€¦ · Web viewC:\Program Files\Microsoft Monitoring Agent\Agent\Health Service State\Management Packs Procedure 3: Validate if data is being sent up

Select computer from which you want all events to be populated.

Click on ok

Now when you go for Manage Alerts

When you go back to OMS site you can check in case of alerts any triggered immediately you not see

Page 20: gallery.technet.microsoft.com€¦ · Web viewC:\Program Files\Microsoft Monitoring Agent\Agent\Health Service State\Management Packs Procedure 3: Validate if data is being sent up