You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-10-01 - 21:38
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot4.osadl.org (updated Sun Oct 01, 2023 00:45:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4137942381375,3sleep90-21swapper/919:05:4015
4138482355347,4sleep60-21swapper/619:06:0912
4140702346326,11sleep70-21swapper/719:09:0713
4138612346308,11sleep00-21swapper/019:06:190
4138132337318,11sleep140-21swapper/1419:05:456
4140882336318,10sleep80-21swapper/819:09:2414
4140782336316,11sleep150-21swapper/1519:09:157
4139812336318,10sleep40-21swapper/419:08:0110
4139712336318,10sleep120-21swapper/1219:07:524
4141282335317,10sleep110-21swapper/1119:09:593
4139722334316,10sleep130-21swapper/1319:07:535
4138832334315,10sleep50-21swapper/519:06:4111
4139692333315,10sleep100-21swapper/1019:07:512
4138982333313,12sleep10-21swapper/119:06:521
4105522333315,10sleep30-21swapper/319:05:189
4140022332314,10sleep20-21swapper/219:08:148
414514999814,42cyclictest543429-21ssh21:30:2411
41451499871,23cyclictest53-21ksoftirqd/519:51:0011
414514998625,41cyclictest0-21swapper/523:00:1411
414514998625,41cyclictest0-21swapper/523:00:1411
41451499862,42cyclictest635475-21ssh22:47:3611
41451499862,42cyclictest635475-21ssh22:47:3611
414514998524,19cyclictest722725-21kworker/5:100:25:1711
414514998523,20cyclictest0-21swapper/521:55:2611
41451499850,22cyclictest0-21swapper/521:39:2711
414514998220,20cyclictest0-21swapper/500:07:1211
414514998119,42cyclictest0-21swapper/521:13:2511
414499997815,42cyclictest0-21swapper/100:37:021
414499997716,41cyclictest450856-21kworker/1:120:43:161
414499997613,42cyclictest0-21swapper/121:40:221
414514997332,21cyclictest418428-21kworker/5:120:01:5711
414514997331,42cyclictest418428-21kworker/5:119:13:0811
414514997311,21cyclictest0-21swapper/519:48:4611
414514997310,21cyclictest610420-21ssh22:23:3411
414514997310,21cyclictest0-21swapper/521:40:4911
41451499729,21cyclictest53-21ksoftirqd/520:14:0611
41451499729,21cyclictest418428-21kworker/5:120:28:2011
414514997231,41cyclictest418428-21kworker/5:120:07:4811
414514997210,20cyclictest418428-21kworker/5:119:58:4411
41451499708,42cyclictest681-21systemd-journal20:41:0011
414514997029,20cyclictest141rcu_preempt21:45:2411
41449999697,20cyclictest0-21swapper/123:12:571
41451499675,20cyclictest0-21swapper/523:35:1611
414514996726,20cyclictest0-21swapper/522:14:1311
41451499663,21cyclictest0-21swapper/523:21:5911
414514996626,20cyclictest0-21swapper/521:25:2411
414514996626,20cyclictest0-21swapper/521:18:1311
41451499652,21cyclictest602899-21sh22:16:2211
41451499650,23cyclictest0-21swapper/523:34:1411
41451499641,21cyclictest0-21swapper/520:16:0411
414514996323,20cyclictest573912-21kworker/5:222:29:1611
41451499631,20cyclictest53-21ksoftirqd/500:22:1211
414514996222,20cyclictest0-21swapper/520:24:2111
414514996220,0cyclictest0-21swapper/523:15:0111
414514996220,0cyclictest0-21swapper/519:30:2011
414514996141,0cyclictest0-21swapper/500:02:1411
414514996120,41cyclictest0-21swapper/521:51:1611
414514996120,21cyclictest484106-21sendmail_mailst20:30:3211
41451499610,41cyclictest0-21swapper/522:38:0711
414514996019,41cyclictest0-21swapper/522:04:4411
414514996019,21cyclictest732807-21ssh00:18:1411
414514996019,21cyclictest418428-21kworker/5:120:49:2511
414514996019,0cyclictest0-21swapper/520:51:3311
41451499600,60cyclictest0-21swapper/520:55:5611
41451499600,19cyclictest0-21swapper/523:59:2611
414514995918,41cyclictest2873-21gmain21:22:5611
414514995918,41cyclictest0-21swapper/521:06:2811
414514995918,20cyclictest508395-21kworker/5:221:02:3611
414514995917,0cyclictest0-21swapper/523:53:3311
41451499590,17cyclictest0-21swapper/523:40:2511
41451499590,17cyclictest0-21swapper/519:41:2011
41451499590,17cyclictest0-21swapper/519:29:2611
41451499590,17cyclictest0-21swapper/519:23:0211
41451499590,17cyclictest0-21swapper/519:15:1811
414514995817,0cyclictest0-21swapper/523:18:3711
41451499580,17cyclictest0-21swapper/522:52:0111
41451499580,17cyclictest0-21swapper/522:52:0011
414499995817,21cyclictest0-21swapper/122:59:401
414499995817,21cyclictest0-21swapper/122:59:401
414499995816,21cyclictest0-21swapper/120:50:221
414514995716,0cyclictest0-21swapper/522:09:1711
414514995716,0cyclictest0-21swapper/500:15:0111
414499995716,21cyclictest0-21swapper/123:51:491
414499995716,21cyclictest0-21swapper/123:08:561
414499995716,21cyclictest0-21swapper/122:13:101
414499995716,21cyclictest0-21swapper/121:45:161
414499995715,21cyclictest0-21swapper/123:25:241
414499995715,21cyclictest0-21swapper/121:13:351
414514995610,0cyclictest0-21swapper/520:37:1011
414499995616,20cyclictest693699-21ssh23:43:171
414499995615,41cyclictest0-21swapper/121:34:161
414499995615,21cyclictest0-21swapper/121:54:381
414499995615,21cyclictest0-21swapper/121:08:081
414499995615,21cyclictest0-21swapper/119:55:331
414499995615,21cyclictest0-21swapper/100:01:241
414499995613,42cyclictest681-21systemd-journal23:19:351
414499995515,20cyclictest0-21swapper/119:40:201
414499995514,21cyclictest0-21swapper/122:54:231
414499995514,21cyclictest0-21swapper/122:54:221
414499995514,21cyclictest0-21swapper/122:42:301
414499995514,21cyclictest0-21swapper/121:37:411
414499995514,21cyclictest0-21swapper/120:49:331
414499995514,21cyclictest0-21swapper/119:37:091
414499995513,21cyclictest0-21swapper/122:34:551
414514995413,0cyclictest0-21swapper/522:34:5611
414499995414,21cyclictest0-21swapper/122:09:111
414499995413,21cyclictest0-21swapper/123:35:161
414499995413,21cyclictest0-21swapper/100:18:321
414499995411,42cyclictest466507-21memory20:10:281
414514995333,20cyclictest0-21swapper/523:47:0311
414514995313,20cyclictest0-21swapper/522:57:4111
414514995313,20cyclictest0-21swapper/522:57:4111
414514995312,0cyclictest0-21swapper/523:26:3611
414499995312,21cyclictest0-21swapper/121:56:041
414499995312,21cyclictest0-21swapper/121:17:331
414514995210,20cyclictest0-21swapper/522:42:4911
414499995232,20cyclictest483747-21missed_timers20:30:281
414499995127,24cyclictest0-21swapper/121:00:301
414499995110,21cyclictest0-21swapper/122:15:561
41451499509,20cyclictest0-21swapper/500:34:0611
414514995010,20cyclictest418428-21kworker/5:119:39:5711
41449999509,21cyclictest0-21swapper/123:01:081
41449999509,21cyclictest0-21swapper/123:01:081
41449999507,21cyclictest0-21swapper/122:20:441
41449999505,21cyclictest0-21swapper/121:26:561
414499995010,20cyclictest0-21swapper/123:45:411
41449999498,21cyclictest0-21swapper/123:22:061
41449999498,21cyclictest0-21swapper/122:01:261
41449999498,21cyclictest0-21swapper/120:57:321
41449999495,21cyclictest0-21swapper/122:37:591
41451499487,21cyclictest0-21swapper/523:09:1011
41449999487,21cyclictest0-21swapper/121:21:161
41449999486,42cyclictest0-21swapper/100:23:501
41449999485,21cyclictest0-21swapper/122:45:421
41449999485,21cyclictest0-21swapper/122:45:421
41449999477,20cyclictest0-21swapper/119:27:021
41449999466,20cyclictest681-21systemd-journal00:32:061
41449999464,0cyclictest0-21swapper/100:05:131
41449999455,20cyclictest681-21systemd-journal20:21:051
41449999454,21cyclictest0-21swapper/119:46:081
41449999454,21cyclictest0-21swapper/119:30:161
41449999453,42cyclictest0-21swapper/120:01:281
41449999437,21cyclictest0-21swapper/100:11:251
41453999426,11cyclictest676032-21/usr/sbin/munin23:30:364
41453999420,21cyclictest0-21swapper/1200:39:224
41451499421,21cyclictest0-21swapper/500:37:2411
414499994217,0cyclictest0-21swapper/123:33:261
41449999420,18cyclictest0-21swapper/123:57:161
41453999415,11cyclictest741121-21ssh00:25:304
414499994117,20cyclictest0-21swapper/120:36:241
414499994117,0cyclictest0-21swapper/122:27:511
414499994117,0cyclictest0-21swapper/120:26:401
414499994117,0cyclictest0-21swapper/119:21:501
41449999410,19cyclictest0-21swapper/100:29:131
41453999404,25cyclictest0-21swapper/1219:28:574
41453999404,11cyclictest0-21swapper/1220:34:514
41453999404,11cyclictest0-21swapper/1219:39:564
41453999404,11cyclictest0-21swapper/1200:14:314
414499994017,20cyclictest0-21swapper/119:17:101
414499994016,0cyclictest0-21swapper/120:05:441
414499994016,0cyclictest0-21swapper/119:51:321
414499994016,0cyclictest0-21swapper/119:11:341
414499994015,0cyclictest0-21swapper/120:15:361
414542993817,21cyclictest0-21swapper/1322:30:345
414529993838,0cyclictest655962-21kworker/9:123:24:1615
414510993714,23cyclictest0-21swapper/423:44:1510
414529992625,1cyclictest520188-21kworker/9:121:38:4815
414529992625,1cyclictest463779-21kworker/9:020:20:3815
414529992623,3cyclictest463779-21kworker/9:020:31:4515
414529992623,3cyclictest409496-21kworker/9:019:25:4315
414529992525,0cyclictest751900-21kworker/9:200:37:4215
414529992525,0cyclictest730109-21kworker/9:100:29:3615
414529992525,0cyclictest730109-21kworker/9:100:20:5315
414529992525,0cyclictest717075-21kworker/9:200:06:4115
414529992525,0cyclictest717075-21kworker/9:200:02:4715
414529992525,0cyclictest655962-21kworker/9:123:57:2715
414529992525,0cyclictest655962-21kworker/9:123:46:3215
414529992525,0cyclictest655962-21kworker/9:123:40:4815
414529992525,0cyclictest655962-21kworker/9:123:31:4115
414529992525,0cyclictest626921-21kworker/9:223:04:4115
414529992525,0cyclictest626921-21kworker/9:223:04:4015
414529992525,0cyclictest626921-21kworker/9:222:57:0415
414529992525,0cyclictest626921-21kworker/9:222:57:0415
414529992525,0cyclictest626921-21kworker/9:222:53:3515
414529992525,0cyclictest626921-21kworker/9:222:53:3415
414529992525,0cyclictest626921-21kworker/9:222:48:5515
414529992525,0cyclictest626921-21kworker/9:222:48:5415
414529992525,0cyclictest626921-21kworker/9:222:41:2815
414529992525,0cyclictest520188-21kworker/9:122:31:3615
414529992525,0cyclictest520188-21kworker/9:122:26:3815
414529992525,0cyclictest520188-21kworker/9:122:16:0515
414529992525,0cyclictest520188-21kworker/9:122:12:1415
414529992525,0cyclictest520188-21kworker/9:122:09:1615
414529992525,0cyclictest520188-21kworker/9:122:01:0415
414529992525,0cyclictest520188-21kworker/9:121:57:5315
414529992525,0cyclictest520188-21kworker/9:121:52:1415
414529992525,0cyclictest520188-21kworker/9:121:49:0415
414529992525,0cyclictest520188-21kworker/9:121:34:4015
414529992525,0cyclictest520188-21kworker/9:121:19:3615
414529992525,0cyclictest463779-21kworker/9:021:06:4815
414529992525,0cyclictest463779-21kworker/9:021:02:2915
414529992525,0cyclictest463779-21kworker/9:020:59:4215
414529992525,0cyclictest463779-21kworker/9:020:42:0415
414529992525,0cyclictest463779-21kworker/9:020:11:3315
414529992525,0cyclictest432652-21kworker/9:220:06:4615
414529992525,0cyclictest432652-21kworker/9:219:59:5015
414529992525,0cyclictest432652-21kworker/9:219:45:4315
414529992525,0cyclictest432652-21kworker/9:219:41:1615
414529992525,0cyclictest409496-21kworker/9:019:20:0115
414529992525,0cyclictest409496-21kworker/9:019:18:1415
414529992522,3cyclictest432652-21kworker/9:220:00:5615
414529992424,0cyclictest746341-21kworker/9:000:31:2115
414529992424,0cyclictest730109-21kworker/9:100:15:2115
414529992424,0cyclictest717075-21kworker/9:200:11:0415
414529992424,0cyclictest655962-21kworker/9:123:51:4215
414529992424,0cyclictest655962-21kworker/9:123:36:2015
414529992424,0cyclictest655962-21kworker/9:123:26:0715
414529992424,0cyclictest655962-21kworker/9:123:15:1215
414529992424,0cyclictest626921-21kworker/9:223:10:1415
414529992424,0cyclictest626921-21kworker/9:223:05:5315
414529992424,0cyclictest520188-21kworker/9:122:36:1615
414529992424,0cyclictest520188-21kworker/9:122:20:1515
414529992424,0cyclictest520188-21kworker/9:121:40:5215
414529992424,0cyclictest520188-21kworker/9:121:28:0115
414529992424,0cyclictest520188-21kworker/9:121:23:5215
414529992424,0cyclictest463779-21kworker/9:021:11:0815
414529992424,0cyclictest463779-21kworker/9:020:51:2615
414529992424,0cyclictest463779-21kworker/9:020:45:0815
414529992424,0cyclictest463779-21kworker/9:020:35:2115
414529992424,0cyclictest463779-21kworker/9:020:25:1015
414529992424,0cyclictest463779-21kworker/9:020:15:0415
414529992424,0cyclictest432652-21kworker/9:219:50:2015
414529992424,0cyclictest432652-21kworker/9:219:35:1015
414529992424,0cyclictest432652-21kworker/9:219:30:4615
414529992424,0cyclictest409496-21kworker/9:019:10:1215
414542992321,1cyclictest549898-21kworker/13:022:21:425
41451899230,13cyclictest0-21swapper/621:55:5812
414542992221,1cyclictest748279-21kworker/13:100:38:385
414542992221,1cyclictest665349-21kworker/13:223:59:295
414542992221,1cyclictest665349-21kworker/13:223:54:405
414542992221,1cyclictest665349-21kworker/13:223:33:255
414542992221,1cyclictest665349-21kworker/13:223:29:415
414542992221,1cyclictest665349-21kworker/13:200:20:475
414542992221,1cyclictest665349-21kworker/13:200:07:325
414542992221,1cyclictest549898-21kworker/13:023:16:065
414542992221,1cyclictest549898-21kworker/13:023:14:245
414542992221,1cyclictest549898-21kworker/13:022:54:565
414542992221,1cyclictest549898-21kworker/13:022:54:565
414542992221,1cyclictest549898-21kworker/13:022:45:095
414542992221,1cyclictest549898-21kworker/13:022:45:095
414542992221,1cyclictest549898-21kworker/13:022:42:155
414542992221,1cyclictest549898-21kworker/13:022:37:205
414542992221,1cyclictest549898-21kworker/13:022:26:565
414542992221,1cyclictest549898-21kworker/13:022:12:525
414542992221,1cyclictest549898-21kworker/13:021:52:015
414542992221,1cyclictest549898-21kworker/13:021:44:165
414542992221,1cyclictest517419-21kworker/13:121:30:525
414542992221,1cyclictest517419-21kworker/13:121:26:575
414542992221,1cyclictest517419-21kworker/13:121:12:085
414542992221,1cyclictest238837-21kworker/13:021:04:045
414542992221,1cyclictest238837-21kworker/13:020:57:215
414542992221,1cyclictest238837-21kworker/13:020:51:105
414542992221,1cyclictest238837-21kworker/13:020:48:305
414542992221,1cyclictest238837-21kworker/13:020:44:325
414542992221,1cyclictest238837-21kworker/13:020:35:425
414542992221,1cyclictest238837-21kworker/13:020:30:555
414542992221,1cyclictest238837-21kworker/13:020:25:515
414542992221,1cyclictest238837-21kworker/13:020:23:105
414542992221,1cyclictest238837-21kworker/13:020:15:025
414542992221,1cyclictest238837-21kworker/13:019:51:185
414542992221,1cyclictest238837-21kworker/13:019:46:065
414542992221,1cyclictest238837-21kworker/13:019:43:275
414542992221,1cyclictest238837-21kworker/13:019:39:005
414542992221,1cyclictest238837-21kworker/13:019:29:185
414542992221,1cyclictest238837-21kworker/13:019:13:485
414542992121,0cyclictest714195-21kworker/13:000:00:075
414542992121,0cyclictest665349-21kworker/13:223:45:445
414542992121,0cyclictest665349-21kworker/13:223:40:205
414542992121,0cyclictest665349-21kworker/13:223:36:065
414542992121,0cyclictest665349-21kworker/13:223:20:495
414542992121,0cyclictest665349-21kworker/13:200:30:295
414542992121,0cyclictest665349-21kworker/13:200:25:265
414542992121,0cyclictest665349-21kworker/13:200:19:435
414542992121,0cyclictest665349-21kworker/13:200:11:085
414542992121,0cyclictest549898-21kworker/13:023:07:085
414542992121,0cyclictest549898-21kworker/13:023:00:155
414542992121,0cyclictest549898-21kworker/13:023:00:155
414542992121,0cyclictest549898-21kworker/13:022:06:205
414542992121,0cyclictest549898-21kworker/13:022:00:205
414542992121,0cyclictest549898-21kworker/13:021:56:315
414542992121,0cyclictest549898-21kworker/13:021:45:215
414542992121,0cyclictest517419-21kworker/13:121:35:185
414542992121,0cyclictest517419-21kworker/13:121:22:075
414542992121,0cyclictest517419-21kworker/13:121:17:125
414542992121,0cyclictest238837-21kworker/13:021:05:345
414542992121,0cyclictest238837-21kworker/13:020:10:395
414542992121,0cyclictest238837-21kworker/13:020:05:575
414542992121,0cyclictest238837-21kworker/13:020:00:005
414542992121,0cyclictest238837-21kworker/13:019:55:085
414542992121,0cyclictest238837-21kworker/13:019:30:525
414542992121,0cyclictest238837-21kworker/13:019:20:175
414542992121,0cyclictest238837-21kworker/13:019:15:055
414542992120,1cyclictest549898-21kworker/13:022:15:515
414542992120,0cyclictest549898-21kworker/13:022:55:045
414542992120,0cyclictest549898-21kworker/13:022:55:045
414539992111,0cyclictest0-21swapper/1200:02:584
414539992110,11cyclictest0-21swapper/1223:52:344
414539992110,11cyclictest0-21swapper/1223:41:344
414539992110,11cyclictest0-21swapper/1222:35:404
414539992110,11cyclictest0-21swapper/1222:24:414
414539992110,11cyclictest0-21swapper/1221:18:474
41453999210,21cyclictest0-21swapper/1222:50:384
41453999210,21cyclictest0-21swapper/1222:50:384
414537992111,0cyclictest0-21swapper/1123:04:593
414537992111,0cyclictest0-21swapper/1123:04:583
41452299210,21cyclictest0-21swapper/723:22:4713
41452299210,21cyclictest0-21swapper/720:57:2713
41452299210,21cyclictest0-21swapper/720:41:2013
41452299210,21cyclictest0-21swapper/719:54:5613
41452299210,21cyclictest0-21swapper/719:47:3613
41452299210,21cyclictest0-21swapper/719:39:0013
41450399210,21cyclictest0-21swapper/223:05:438
41450399210,21cyclictest0-21swapper/221:13:588
41450399210,21cyclictest0-21swapper/220:57:268
41450399210,21cyclictest0-21swapper/220:41:218
41450399210,21cyclictest0-21swapper/220:35:348
41450399210,21cyclictest0-21swapper/219:54:578
41450399210,21cyclictest0-21swapper/219:47:368
41450399210,21cyclictest0-21swapper/219:39:008
41450399210,21cyclictest0-21swapper/200:02:478
41453999209,11cyclictest0-21swapper/1223:08:374
41453999209,11cyclictest0-21swapper/1222:46:404
41453999209,11cyclictest0-21swapper/1222:46:394
41453999209,11cyclictest0-21swapper/1221:07:484
41453999209,11cyclictest0-21swapper/1220:56:504
41453999209,11cyclictest0-21swapper/1220:23:524
41453999209,11cyclictest0-21swapper/1220:12:534
41453999209,11cyclictest0-21swapper/1220:01:554
414537992010,10cyclictest0-21swapper/1123:16:593
41453799200,20cyclictest0-21swapper/1121:15:293
41453799200,0cyclictest0-21swapper/1123:51:493
41453299200,20cyclictest0-21swapper/1000:01:262
41452299200,20cyclictest0-21swapper/723:36:3213
41452299200,20cyclictest0-21swapper/723:29:5313
41452299200,20cyclictest0-21swapper/723:16:3913
41452299200,20cyclictest0-21swapper/723:05:4213
41452299200,20cyclictest0-21swapper/722:15:5113
41452299200,20cyclictest0-21swapper/721:18:5613
41452299200,20cyclictest0-21swapper/721:13:5813
41452299200,20cyclictest0-21swapper/721:05:5813
41452299200,20cyclictest0-21swapper/721:01:5213
41452299200,20cyclictest0-21swapper/720:35:3413
41452299200,20cyclictest0-21swapper/720:34:5413
41452299200,20cyclictest0-21swapper/720:28:1513
41452299200,20cyclictest0-21swapper/720:24:0613
41452299200,20cyclictest0-21swapper/720:13:2613
41452299200,20cyclictest0-21swapper/720:07:4313
41452299200,20cyclictest0-21swapper/720:03:2813
41452299200,20cyclictest0-21swapper/719:55:5213
41452299200,20cyclictest0-21swapper/719:40:0113
41452299200,20cyclictest0-21swapper/719:34:3813
41452299200,20cyclictest0-21swapper/719:26:2213
41452299200,20cyclictest0-21swapper/719:22:1413
41452299200,20cyclictest0-21swapper/719:12:5513
41452299200,17cyclictest0-21swapper/721:25:5313
41450399200,20cyclictest0-21swapper/223:57:268
41450399200,20cyclictest0-21swapper/223:46:488
41450399200,20cyclictest0-21swapper/223:41:458
41450399200,20cyclictest0-21swapper/223:38:058
41450399200,20cyclictest0-21swapper/223:32:548
41450399200,20cyclictest0-21swapper/223:28:568
41450399200,20cyclictest0-21swapper/223:22:328
41450399200,20cyclictest0-21swapper/223:16:168
41450399200,20cyclictest0-21swapper/223:11:458
41450399200,20cyclictest0-21swapper/223:02:088
41450399200,20cyclictest0-21swapper/223:02:088
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional