You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-06-19 - 13:55
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot3.osadl.org (updated Wed Jun 19, 2024 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28527599660,64cyclictest455742-21cron00:00:001
285275996461,2cyclictest0-21swapper/121:36:071
28527599640,2cyclictest323309-21diskmemload23:44:591
285275996361,1cyclictest0-21swapper/123:01:221
285275996359,2cyclictest0-21swapper/119:10:431
28527599630,2cyclictest0-21swapper/119:15:411
285275996144,15cyclictest456480-21kworker/1:200:25:191
285275996058,1cyclictest0-21swapper/123:23:081
285275996057,2cyclictest0-21swapper/122:08:071
285275996044,15cyclictest377399-21kworker/1:122:40:191
285275996044,15cyclictest294876-21kworker/1:119:50:131
285275996041,18cyclictest401414-21kworker/1:222:50:131
285275996041,17cyclictest333409-21kworker/1:121:30:151
285275996040,18cyclictest2268523-1kworker/1:2H20:15:001
285272996056,2cyclictest434093-21kworker/0:123:40:170
285275995957,1cyclictest0-21swapper/121:15:111
285275995957,1cyclictest0-21swapper/121:01:131
285275995957,1cyclictest0-21swapper/119:37:511
285275995942,16cyclictest456480-21kworker/1:200:15:171
285275995942,16cyclictest315577-21kworker/1:220:45:191
285275995856,1cyclictest0-21swapper/121:05:401
285275995843,14cyclictest377399-21kworker/1:122:20:001
285275995843,14cyclictest2268523-1kworker/1:2H22:35:061
285275995842,15cyclictest357135-21kworker/1:122:02:551
285275995840,17cyclictest333409-21kworker/1:121:22:491
285275995838,19cyclictest377399-21kworker/1:122:20:001
285275995743,14cyclictest368271-21kworker/1:022:10:271
285275995743,14cyclictest321501-21kworker/1:021:11:431
285275995743,14cyclictest310623-21kworker/1:120:30:491
285275995742,14cyclictest456480-21kworker/1:200:35:001
285275995742,14cyclictest405340-21kworker/1:023:13:101
285275995742,14cyclictest351431-21kworker/1:021:45:161
285275995741,15cyclictest428464-21kworker/1:123:30:141
285275995741,15cyclictest2268523-1kworker/1:2H00:03:121
285275995642,14cyclictest405340-21kworker/1:022:58:061
285275995642,14cyclictest290517-21kworker/1:019:25:201
285275995641,14cyclictest456480-21kworker/1:200:20:161
285275995641,14cyclictest428464-21kworker/1:123:27:421
285275995641,14cyclictest405340-21kworker/1:023:05:161
285275995641,14cyclictest377399-21kworker/1:122:34:481
285275995641,14cyclictest305986-21kworker/1:220:17:331
285275995641,14cyclictest294876-21kworker/1:120:05:161
285275995641,14cyclictest2268523-1kworker/1:2H20:37:131
285275995640,15cyclictest294876-21kworker/1:120:00:131
285275995640,15cyclictest294876-21kworker/1:119:40:151
285275995639,16cyclictest405340-21kworker/1:023:15:151
285275995639,16cyclictest2268523-1kworker/1:2H23:55:001
285275995639,16cyclictest2268523-1kworker/1:2H23:55:001
285275995540,14cyclictest456480-21kworker/1:200:30:201
285275995540,14cyclictest456480-21kworker/1:200:10:011
285275995540,14cyclictest377399-21kworker/1:122:45:141
285275995540,14cyclictest307799-21kworker/1:020:25:061
285275995540,14cyclictest280094-21kworker/1:119:20:151
285275995537,17cyclictest333409-21kworker/1:121:25:151
285280995450,3cyclictest4136088-1kworker/3:0H19:35:483
285280995449,3cyclictest4136088-1kworker/3:0H19:23:423
285275995451,2cyclictest0-21swapper/119:32:121
285275995440,14cyclictest307799-21kworker/1:020:24:121
285275995439,14cyclictest381902-21kworker/1:222:25:071
285275995439,14cyclictest357135-21kworker/1:121:55:011
285275995439,14cyclictest310623-21kworker/1:120:40:211
285272995449,3cyclictest3644074-1kworker/0:1H22:33:000
285278995349,3cyclictest339167-21kworker/2:221:36:422
285278995349,2cyclictest360695-21kworker/2:123:32:182
285278995348,3cyclictest307595-21kworker/2:021:00:112
285275995339,14cyclictest315577-21kworker/1:220:55:181
285275995339,14cyclictest294876-21kworker/1:119:45:011
285275995338,14cyclictest456480-21kworker/1:200:05:011
285275995338,14cyclictest315577-21kworker/1:220:50:161
285275995338,14cyclictest2268523-1kworker/1:2H19:55:351
285275995335,17cyclictest351431-21kworker/1:021:50:171
285280995248,2cyclictest395908-21kworker/3:022:45:063
285280995247,3cyclictest4136088-1kworker/3:0H19:11:073
285278995249,2cyclictest360695-21kworker/2:123:55:182
285278995249,2cyclictest307595-21kworker/2:020:45:422
285278995248,3cyclictest301383-21kworker/2:120:05:492
285278995248,2cyclictest3368625-1kworker/2:0H21:15:132
285278995246,3cyclictest3368625-1kworker/2:0H22:45:132
285275995250,1cyclictest0-21swapper/123:36:421
285275995237,14cyclictest346894-21kworker/1:221:40:151
28527599520,51cyclictest0-21swapper/123:48:421
285272995247,3cyclictest3644074-1kworker/0:1H20:55:330
285272995246,3cyclictest3644074-1kworker/0:1H21:20:160
285280995147,2cyclictest430066-21kworker/3:000:16:083
285280995146,3cyclictest370284-1kworker/3:1H23:05:423
285280995146,3cyclictest370284-1kworker/3:1H00:07:423
285278995147,2cyclictest307595-21kworker/2:021:27:122
285278995146,3cyclictest360695-21kworker/2:122:10:422
285278995146,3cyclictest301383-21kworker/2:120:15:422
285280995047,2cyclictest404106-21kworker/3:222:53:203
285280995047,2cyclictest349296-21kworker/3:121:49:553
285280995045,3cyclictest370284-1kworker/3:1H23:37:433
285280995045,3cyclictest370284-1kworker/3:1H23:00:273
285278995047,2cyclictest360695-21kworker/2:122:30:052
285278995046,2cyclictest294954-21kworker/2:019:47:422
285278995046,2cyclictest284700-21kworker/2:119:34:212
285278995045,3cyclictest459674-21kworker/2:000:10:062
285278995045,3cyclictest3368625-1kworker/2:0H20:25:212
285278995044,4cyclictest3368625-1kworker/2:0H00:21:112
285280994945,3cyclictest430066-21kworker/3:000:01:423
285278994944,3cyclictest360695-21kworker/2:122:23:042
285278994944,3cyclictest301383-21kworker/2:120:13:222
285278994943,4cyclictest360695-21kworker/2:123:43:492
285272994944,3cyclictest3644074-1kworker/0:1H19:35:150
285272994943,3cyclictest3644074-1kworker/0:1H22:20:010
285280994845,2cyclictest299512-21kworker/3:219:54:553
285280994844,3cyclictest430066-21kworker/3:000:13:423
285280994844,3cyclictest4136088-1kworker/3:0H20:54:423
285280994844,3cyclictest370284-1kworker/3:1H00:38:333
285280994844,3cyclictest290262-21kworker/3:119:44:553
285278994844,3cyclictest3368625-1kworker/2:0H23:35:342
285278994844,3cyclictest307595-21kworker/2:021:06:062
285278994844,3cyclictest307595-21kworker/2:020:44:122
285278994844,3cyclictest294954-21kworker/2:019:41:102
285278994843,3cyclictest339167-21kworker/2:221:40:412
285278994843,3cyclictest3368625-1kworker/2:0H21:14:072
285278994843,3cyclictest307595-21kworker/2:020:24:062
285278994842,4cyclictest3368625-1kworker/2:0H22:53:092
285278994840,4cyclictest3368625-1kworker/2:0H19:30:002
285272994844,3cyclictest434093-21kworker/0:123:49:470
285272994843,3cyclictest424407-21kworker/0:323:23:180
285272994843,3cyclictest3644074-1kworker/0:1H23:51:420
285272994843,3cyclictest3644074-1kworker/0:1H23:51:410
285272994843,3cyclictest3644074-1kworker/0:1H19:20:430
285272994842,4cyclictest3644074-1kworker/0:1H21:55:200
285280994744,2cyclictest424798-21kworker/3:223:24:553
285280994742,3cyclictest4136088-1kworker/3:0H20:20:133
285280994742,3cyclictest370284-1kworker/3:1H22:35:173
285278994744,2cyclictest339167-21kworker/2:221:53:132
285278994742,4cyclictest3368625-1kworker/2:0H23:28:482
285278994742,3cyclictest360695-21kworker/2:123:17:062
285278994742,3cyclictest3368625-1kworker/2:0H22:02:082
285278994742,3cyclictest307595-21kworker/2:021:20:332
285278994741,3cyclictest3368625-1kworker/2:0H20:50:162
285272994744,2cyclictest3644074-1kworker/0:1H20:39:120
285272994744,2cyclictest3644074-1kworker/0:1H19:18:510
285272994744,2cyclictest360000-21kworker/0:122:20:360
285272994742,3cyclictest3644074-1kworker/0:1H00:15:160
285280994643,2cyclictest430066-21kworker/3:023:45:213
285280994643,2cyclictest4136088-1kworker/3:0H20:18:413
285280994643,2cyclictest370284-1kworker/3:1H23:59:113
285280994642,3cyclictest370284-1kworker/3:1H23:44:473
285280994642,3cyclictest370284-1kworker/3:1H23:18:423
285280994642,2cyclictest4136088-1kworker/3:0H20:05:433
285280994642,2cyclictest370284-1kworker/3:1H00:21:063
285278994642,2cyclictest3368625-1kworker/2:0H19:55:172
285278994641,3cyclictest3368625-1kworker/2:0H21:32:072
285278994640,3cyclictest284700-21kworker/2:119:13:232
285272994643,2cyclictest448056-21kworker/0:300:22:570
285272994642,2cyclictest3644074-1kworker/0:1H19:29:120
285272994641,3cyclictest284729-21kworker/0:119:10:240
285272994640,4cyclictest3644074-1kworker/0:1H21:07:510
285280994541,3cyclictest4136088-1kworker/3:0H21:37:573
285280994540,3cyclictest4136088-1kworker/3:0H21:12:443
285278994542,2cyclictest339167-21kworker/2:221:47:522
285278994540,3cyclictest307595-21kworker/2:020:39:132
285272994543,1cyclictest448056-21kworker/0:300:10:160
285272994542,2cyclictest391783-21kworker/0:222:58:040
285272994542,2cyclictest391783-21kworker/0:222:43:010
285272994541,3cyclictest3644074-1kworker/0:1H20:05:230
285272994541,2cyclictest271854-21kworker/0:319:50:120
285272994540,3cyclictest3644074-1kworker/0:1H22:50:130
285272994540,3cyclictest3644074-1kworker/0:1H22:46:420
285272994540,3cyclictest360000-21kworker/0:122:10:180
285272994539,3cyclictest3644074-1kworker/0:1H23:05:150
285280994441,2cyclictest4136088-1kworker/3:0H20:14:423
285280994441,2cyclictest299512-21kworker/3:219:59:563
285280994440,3cyclictest4136088-1kworker/3:0H21:44:443
285280994440,3cyclictest4136088-1kworker/3:0H19:30:313
285280994438,3cyclictest370284-1kworker/3:1H23:13:083
285278994441,2cyclictest284700-21kworker/2:119:16:422
285278994440,3cyclictest339167-21kworker/2:221:59:422
285278994439,3cyclictest459674-21kworker/2:000:08:552
285278994439,3cyclictest3368625-1kworker/2:0H20:32:352
285278994439,3cyclictest294954-21kworker/2:020:01:092
285278994438,4cyclictest3368625-1kworker/2:0H20:55:272
285278994438,4cyclictest3368625-1kworker/2:0H19:51:412
285278994438,4cyclictest3368625-1kworker/2:0H19:20:132
285272994441,2cyclictest3644074-1kworker/0:1H20:48:430
285272994441,2cyclictest3644074-1kworker/0:1H19:43:020
285272994440,3cyclictest391783-21kworker/0:223:00:160
285272994440,3cyclictest387719-21kworker/0:122:36:080
285272994439,3cyclictest3644074-1kworker/0:1H00:05:170
285272994439,3cyclictest313733-21kworker/0:221:04:110
285272994437,4cyclictest3644074-1kworker/0:1H00:35:170
285280994340,2cyclictest370284-1kworker/3:1H22:12:423
285280994340,2cyclictest313730-21kworker/3:120:40:133
285280994338,3cyclictest4136088-1kworker/3:0H21:07:523
285280994337,4cyclictest370284-1kworker/3:1H23:53:123
285280994337,4cyclictest370284-1kworker/3:1H23:53:123
285278994338,3cyclictest466266-21kworker/2:200:33:562
285272994340,2cyclictest297983-21kworker/0:020:16:200
285272994339,2cyclictest3644074-1kworker/0:1H21:50:120
285272994339,2cyclictest310620-21kworker/0:120:31:380
285272994337,3cyclictest3644074-1kworker/0:1H00:30:200
285280994239,2cyclictest331587-21kworker/3:221:29:543
285280994239,1cyclictest4136088-1kworker/3:0H20:25:143
285280994238,3cyclictest4136088-1kworker/3:0H22:07:413
285280994237,4cyclictest4136088-1kworker/3:0H21:54:413
285280994237,4cyclictest370284-1kworker/3:1H22:57:143
285280994237,3cyclictest370284-1kworker/3:1H22:32:583
285272994239,2cyclictest360000-21kworker/0:122:05:000
285272994237,3cyclictest3644074-1kworker/0:1H20:50:460
285280994138,2cyclictest430066-21kworker/3:023:34:463
285280994138,2cyclictest4136088-1kworker/3:0H21:58:103
285280994138,2cyclictest378324-21kworker/3:022:24:363
285280994137,3cyclictest4136088-1kworker/3:0H21:31:053
285280994137,3cyclictest370284-1kworker/3:1H22:17:423
285280994137,2cyclictest370284-1kworker/3:1H22:40:193
285278994137,2cyclictest360695-21kworker/2:122:37:122
285278994136,3cyclictest360695-21kworker/2:100:00:242
285278994136,2cyclictest3368625-1kworker/2:0H22:25:172
285272994138,2cyclictest391783-21kworker/0:223:15:270
285272994137,3cyclictest3644074-1kworker/0:1H21:35:190
285272994136,3cyclictest3644074-1kworker/0:1H23:30:430
285272994136,3cyclictest3644074-1kworker/0:1H21:10:160
285272994136,3cyclictest3644074-1kworker/0:1H20:02:180
285272994135,3cyclictest3644074-1kworker/0:1H21:40:140
285280994036,3cyclictest4136088-1kworker/3:0H19:17:233
285280994036,3cyclictest370284-1kworker/3:1H23:27:123
285280994036,3cyclictest370284-1kworker/3:1H00:34:423
285280994036,2cyclictest4136088-1kworker/3:0H21:15:163
285278994036,2cyclictest360695-21kworker/2:123:03:122
285278994036,2cyclictest3368625-1kworker/2:0H22:58:122
285272994038,1cyclictest313733-21kworker/0:221:15:420
285272994036,2cyclictest3644074-1kworker/0:1H19:45:190
285272994035,3cyclictest3644074-1kworker/0:1H20:21:410
285280993935,3cyclictest4136088-1kworker/3:0H20:55:063
285280993935,3cyclictest370284-1kworker/3:1H00:29:553
285280993934,3cyclictest4136088-1kworker/3:0H20:35:103
285280993933,4cyclictest370284-1kworker/3:1H22:30:003
285278993936,2cyclictest360695-21kworker/2:122:41:092
285278993935,2cyclictest3368625-1kworker/2:0H23:45:152
285278993933,4cyclictest3368625-1kworker/2:0H00:26:422
285272993936,2cyclictest434093-21kworker/0:123:38:130
285272993936,2cyclictest3644074-1kworker/0:1H23:15:000
285272993936,2cyclictest302878-21kworker/0:120:10:220
285272993936,2cyclictest297983-21kworker/0:019:55:240
285272993934,3cyclictest3644074-1kworker/0:1H00:03:180
285280993832,3cyclictest4136088-1kworker/3:0H21:02:443
285278993835,2cyclictest466266-21kworker/2:200:37:122
285272993836,1cyclictest3644074-1kworker/0:1H19:34:410
285272993834,3cyclictest364535-21kworker/0:022:05:150
285272993833,2cyclictest3644074-1kworker/0:1H21:45:150
285272993832,3cyclictest3644074-1kworker/0:1H23:25:140
285280993733,3cyclictest313730-21kworker/3:120:49:543
285280993732,3cyclictest4136088-1kworker/3:0H22:03:293
285278993734,2cyclictest3368625-1kworker/2:0H23:10:032
285278993734,2cyclictest284700-21kworker/2:119:35:062
285278993733,3cyclictest3368625-1kworker/2:0H22:18:082
285280993631,3cyclictest4136088-1kworker/3:0H20:04:563
285278993633,2cyclictest3368625-1kworker/2:0H23:22:072
285272993633,2cyclictest448056-21kworker/0:323:57:420
285272993633,2cyclictest313733-21kworker/0:221:25:230
285278993530,3cyclictest3368625-1kworker/2:0H23:05:162
285272993532,2cyclictest3644074-1kworker/0:1H20:25:040
285280993430,3cyclictest4136088-1kworker/3:0H20:33:413
285272993431,2cyclictest448056-21kworker/0:300:25:120
285272993431,2cyclictest313733-21kworker/0:221:32:420
285280993329,3cyclictest331587-21kworker/3:221:21:183
285272993330,2cyclictest313733-21kworker/0:220:42:280
285272993229,2cyclictest378306-21kworker/0:222:28:080
285278993127,3cyclictest3368625-1kworker/2:0H00:17:072
285280992926,2cyclictest4136088-1kworker/3:0H19:25:463
285275992622,2cyclictest0-21swapper/119:10:011
285278992521,3cyclictest3368625-1kworker/2:0H23:53:422
285278992521,3cyclictest3368625-1kworker/2:0H23:53:422
28528099240,4cyclictest297132-21/usr/sbin/munin19:45:203
28527899241,21cyclictest323309-21diskmemload22:09:342
28528099151,13cyclictest0-21swapper/319:10:013
2852789984,2cyclictest285288-21latency_hist19:10:012
2852729985,2cyclictest271854-21kworker/0:319:10:000
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional