You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-12 - 01:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Fri Jun 12, 2026 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
104299994,35cyclictest0-21swapper/023:33:480
104299985,13cyclictest0-21swapper/021:37:170
104299964,42cyclictest0-21swapper/022:29:040
104299964,25cyclictest784-21ssh21:07:020
104899953,13cyclictest0-21swapper/222:02:122
104299954,36cyclictest0-21swapper/023:41:200
104299953,25cyclictest0-21swapper/023:26:410
1042999524,23cyclictest12267-21fschecks_count23:46:570
104899943,9cyclictest18715-21needreboot21:32:082
1042999418,12cyclictest0-21swapper/022:07:010
1042999415,8cyclictest18593-21kworker/0:123:01:530
104299937,12cyclictest0-21swapper/022:57:140
104299934,34cyclictest0-21swapper/020:06:580
104299933,26cyclictest0-21swapper/023:42:110
104299924,25cyclictest0-21swapper/021:47:140
1042999236,49cyclictest0-21swapper/021:16:560
104299915,38cyclictest0-21swapper/021:21:570
104299915,25cyclictest0-21swapper/021:27:020
104299914,79cyclictest0-21swapper/000:01:570
104299914,33cyclictest0-21swapper/022:32:060
104299914,26cyclictest0-21swapper/022:17:500
104299914,13cyclictest0-21swapper/022:47:050
1042999117,13cyclictest0-21swapper/022:42:360
1042999117,11cyclictest2045-21telnet21:56:540
1042999041,43cyclictest0-21swapper/023:26:420
104299904,27cyclictest0-21swapper/021:06:450
104299904,27cyclictest0-21swapper/020:12:070
1042999017,13cyclictest0-21swapper/021:41:570
104299895,26cyclictest0-21swapper/021:35:330
104299894,28cyclictest0-21swapper/020:17:050
104299894,25cyclictest0-21swapper/021:13:480
104299894,25cyclictest0-21swapper/021:13:480
1042998926,13cyclictest0-21swapper/023:57:120
1042998926,13cyclictest0-21swapper/023:57:120
1042998919,12cyclictest0-21swapper/000:22:480
104299884,35cyclictest0-21swapper/021:52:010
104299884,28cyclictest0-21swapper/020:47:150
104299884,26cyclictest0-21swapper/022:02:360
1042998831,50cyclictest0-21swapper/000:06:510
104299883,33cyclictest0-21swapper/023:52:010
1042998819,12cyclictest0-21swapper/022:15:160
1042998811,8cyclictest0-21swapper/023:07:130
1048998722,24cyclictest0-21swapper/223:12:072
104299874,76cyclictest0-21swapper/020:56:580
104299874,23cyclictest0-21swapper/019:52:070
104299874,23cyclictest0-21swapper/019:52:070
104299873,26cyclictest0-21swapper/022:55:020
104299864,39cyclictest1312-21unixbench_singl00:17:110
104299864,25cyclictest0-21swapper/023:17:160
104299864,25cyclictest0-21swapper/023:17:160
104299864,25cyclictest0-21swapper/022:37:060
104299864,25cyclictest0-21swapper/022:37:060
104299854,27cyclictest0-21swapper/019:02:010
104299854,26cyclictest0-21swapper/019:42:070
1042998528,14cyclictest0-21swapper/000:11:530
104299844,25cyclictest0-21swapper/022:22:100
1042998431,9cyclictest6185-21munin-node19:07:140
219499830,5rtkit-daemon2193-21rtkit-daemon22:29:433
104299833,33cyclictest0-21swapper/019:21:510
1042998225,10cyclictest19840-21grep20:42:050
104299813,10cyclictest0-21swapper/023:12:340
1042997927,12cyclictest0-21swapper/019:32:120
219499730,5rtkit-daemon2193-21rtkit-daemon21:55:293
104899693,12cyclictest0-21swapper/222:37:012
104899693,12cyclictest0-21swapper/222:37:012
219499680,9rtkit-daemon0-21swapper/018:57:062
104799684,54cyclictest0-21swapper/121:27:041
104799684,54cyclictest0-21swapper/100:17:111
104799683,58cyclictest0-21swapper/121:58:451
104799683,57cyclictest0-21swapper/122:14:261
1042996811,15cyclictest620-21gltestperf20:02:080
104799675,54cyclictest0-21swapper/123:47:171
1047996710,34cyclictest0-21swapper/120:31:481
219499660,4rtkit-daemon2193-21rtkit-daemon21:13:313
219499660,4rtkit-daemon2193-21rtkit-daemon21:13:313
104799665,53cyclictest0-21swapper/100:01:571
104799665,52cyclictest1227-21runrttasks22:06:371
104799665,52cyclictest0-21swapper/100:22:101
219499650,5rtkit-daemon2193-21rtkit-daemon23:38:483
104999655,38cyclictest0-21swapper/322:34:313
104799653,54cyclictest29854-21gltestperf22:37:031
104799653,54cyclictest29854-21gltestperf22:37:031
104999644,36cyclictest15281-21munin-node22:18:273
104899644,52cyclictest0-21swapper/222:52:012
1047996445,12cyclictest30922-21sed19:57:071
104799644,51cyclictest7843-21cut22:52:021
104799644,51cyclictest0-21swapper/123:11:591
1048996325,29cyclictest0-21swapper/222:35:402
104799634,51cyclictest4162-21cut19:02:041
104799634,50cyclictest0-21swapper/123:00:021
104799634,49cyclictest0-21swapper/121:17:181
104799633,54cyclictest0-21swapper/121:48:151
104999625,37cyclictest0-21swapper/323:13:363
104999624,39cyclictest0-21swapper/322:56:263
104799624,51cyclictest0-21swapper/121:02:211
104799623,53cyclictest0-21swapper/121:37:301
104799623,53cyclictest0-21swapper/121:33:571
36552613,9sleep13733-21sendmail_mailqu20:07:171
219499610,4rtkit-daemon2193-21rtkit-daemon23:17:413
219499610,4rtkit-daemon2193-21rtkit-daemon23:17:413
1049996143,13cyclictest28481-21gltestperf21:47:053
104899614,50cyclictest0-21swapper/221:26:202
104899613,11cyclictest0-21swapper/223:35:322
104799615,48cyclictest0-21swapper/121:44:271
104799614,50cyclictest0-21swapper/123:42:041
104799614,48cyclictest30328-21latency_hist23:26:411
104799613,50cyclictest0-21swapper/122:32:141
104799613,50cyclictest0-21swapper/120:17:141
1047996116,26cyclictest1547-21nscd23:56:391
1049996022,9cyclictest0-21swapper/321:07:113
104999602,53cyclictest0-21swapper/322:42:123
104899604,13cyclictest0-21swapper/223:21:522
104899603,12cyclictest0-21swapper/222:12:002
1048996019,18cyclictest6858-21ssh21:16:012
1048996019,18cyclictest6858-21ssh21:16:012
104799604,47cyclictest0-21swapper/121:07:091
104799603,50cyclictest25852-21latency_hist20:56:461
104799603,50cyclictest0-21swapper/121:12:041
104799603,50cyclictest0-21swapper/121:12:041
219499590,6rtkit-daemon2193-21rtkit-daemon23:46:023
219499590,6rtkit-daemon0-21swapper/118:56:590
190282594,46sleep30-21swapper/320:41:573
104999594,49cyclictest0-21swapper/323:27:043
104999594,49cyclictest0-21swapper/321:27:173
104899593,13cyclictest0-21swapper/221:52:052
104799594,48cyclictest0-21swapper/123:27:161
104799594,48cyclictest0-21swapper/120:37:141
104799594,48cyclictest0-21swapper/120:37:141
104799594,47cyclictest0-21swapper/122:26:581
1047995917,25cyclictest3014-21sendmail_mailqu23:32:101
303632583,48sleep30-21swapper/322:37:123
303632583,48sleep30-21swapper/322:37:123
104999586,29cyclictest0-21swapper/322:10:263
104999583,49cyclictest7330-21munin-node21:17:063
104899584,47cyclictest0-21swapper/221:17:052
104799588,41cyclictest26098-21hwlatdetect00:06:591
104799586,36cyclictest0-21swapper/122:23:401
104799585,45cyclictest0-21swapper/121:52:061
104799583,48cyclictest0-21swapper/122:07:031
104799583,48cyclictest0-21swapper/119:27:001
104799583,47cyclictest0-21swapper/123:56:571
104799583,47cyclictest0-21swapper/123:56:571
219499570,6rtkit-daemon2193-21rtkit-daemon19:12:212
219499570,6rtkit-daemon2193-21rtkit-daemon19:12:212
106952572,49sleep20-21swapper/223:44:162
104999574,36cyclictest0-21swapper/323:01:163
104999573,48cyclictest0-21swapper/322:25:193
104999573,48cyclictest0-21swapper/300:17:483
1049995723,15cyclictest0-21swapper/323:35:403
1049995721,14cyclictest0-21swapper/321:02:513
104799574,46cyclictest0-21swapper/123:38:501
1042995737,12cyclictest0-21swapper/019:12:130
1042995737,12cyclictest0-21swapper/019:12:130
104999564,34cyclictest0-21swapper/323:09:073
104999564,30cyclictest0-21swapper/319:17:053
104999563,47cyclictest0-21swapper/320:36:573
104999563,47cyclictest0-21swapper/320:36:573
1049995621,14cyclictest0-21swapper/319:47:193
1049995619,14cyclictest0-21swapper/322:11:583
1049995613,26cyclictest25693-21diskmemload23:54:023
1049995613,16cyclictest0-21swapper/323:21:533
104799564,46cyclictest0-21swapper/122:43:531
1047995638,10cyclictest13984-21tr23:01:551
104799563,46cyclictest0-21swapper/121:22:001
104799563,45cyclictest16622-21latency22:17:081
104299564,43cyclictest0-21swapper/020:01:480
230842553,7sleep20-21swapper/200:02:062
168832552,47sleep20-21swapper/221:30:382
104999555,29cyclictest0-21swapper/321:59:133
104999555,29cyclictest0-21swapper/320:22:063
104999555,29cyclictest0-21swapper/320:12:003
104999555,26cyclictest0-21swapper/321:43:433
104999554,31cyclictest0-21swapper/319:02:103
104999554,30cyclictest0-21swapper/321:37:063
104999554,29cyclictest0-21swapper/321:32:003
104999554,28cyclictest0-21swapper/323:06:363
104999553,46cyclictest0-21swapper/322:47:433
104999553,27cyclictest0-21swapper/318:57:173
1049995526,12cyclictest0-21swapper/300:22:093
1049995521,13cyclictest0-21swapper/319:41:493
1049995520,12cyclictest0-21swapper/320:28:143
1049995519,14cyclictest0-21swapper/321:25:393
1049995519,12cyclictest6281-21gltestperf22:02:033
1049995519,10cyclictest25693-21diskmemload23:57:143
1049995519,10cyclictest25693-21diskmemload23:57:143
1049995516,13cyclictest0-21swapper/320:21:473
104899553,11cyclictest0-21swapper/221:48:372
104899552,37cyclictest0-21swapper/220:58:562
104799555,42cyclictest0-21swapper/123:16:521
104799555,42cyclictest0-21swapper/123:16:521
104799554,45cyclictest0-21swapper/123:07:151
104799553,46cyclictest0-21swapper/119:32:221
8032543,8sleep1886-21munin-node20:02:131
274432546,10sleep20-21swapper/200:08:432
219499540,5rtkit-daemon2193-21rtkit-daemon19:35:423
219499540,5rtkit-daemon2193-21rtkit-daemon19:02:062
104999545,29cyclictest0-21swapper/320:52:143
104999545,27cyclictest0-21swapper/300:04:073
104999545,24cyclictest0-21swapper/323:47:123
104999544,30cyclictest0-21swapper/320:57:073
104999544,27cyclictest0-21swapper/319:27:593
104999544,26cyclictest0-21swapper/320:08:083
104999544,26cyclictest0-21swapper/320:03:053
104999544,26cyclictest0-21swapper/319:12:573
104999544,26cyclictest0-21swapper/319:12:573
1049995436,11cyclictest28899-21cut00:11:513
1049995417,14cyclictest0-21swapper/300:06:573
104899544,8cyclictest29655-21ssh21:02:022
104899544,42cyclictest0-21swapper/223:26:522
104899543,9cyclictest0-21swapper/200:12:112
104899543,26cyclictest0-21swapper/223:47:112
104799544,43cyclictest1227-21runrttasks00:16:221
104799543,44cyclictest0-21swapper/122:47:031
104799543,44cyclictest0-21swapper/119:37:071
104799543,44cyclictest0-21swapper/119:17:201
298052532,10sleep30-21swapper/319:56:383
298052532,10sleep30-21swapper/319:56:383
104999534,41cyclictest0-21swapper/319:07:103
104999534,30cyclictest0-21swapper/319:42:023
104999534,27cyclictest0-21swapper/319:58:043
1049995322,10cyclictest14191-21gltestperf19:22:093
104899535,9cyclictest0-21swapper/221:45:382
104899534,10cyclictest0-21swapper/223:56:262
104899533,34cyclictest0-21swapper/222:58:582
104899533,13cyclictest0-21swapper/221:57:302
104899533,11cyclictest0-21swapper/221:07:062
1048995317,19cyclictest0-21swapper/223:04:312
104799534,43cyclictest0-21swapper/120:57:201
104799533,44cyclictest0-21swapper/120:35:401
104799533,43cyclictest0-21swapper/119:52:071
104799533,43cyclictest0-21swapper/119:52:071
104799533,42cyclictest0-21swapper/119:12:001
104799533,42cyclictest0-21swapper/119:12:001
1042995324,22cyclictest0-21swapper/020:27:030
219499520,5rtkit-daemon2193-21rtkit-daemon19:55:042
219499520,5rtkit-daemon2193-21rtkit-daemon19:55:042
104999524,25cyclictest0-21swapper/320:49:283
104899529,26cyclictest0-21swapper/222:26:552
104899523,12cyclictest0-21swapper/223:10:222
104899523,11cyclictest0-21swapper/222:22:062
104899523,11cyclictest0-21swapper/200:16:532
104899523,11cyclictest0-21swapper/200:00:332
104899523,11cyclictest0-21swapper/200:00:332
104799527,36cyclictest0-21swapper/118:57:001
104799524,30cyclictest0-21swapper/119:47:101
104799523,42cyclictest0-21swapper/119:46:491
318772512,9sleep20-21swapper/220:00:402
219499510,5rtkit-daemon2193-21rtkit-daemon19:50:042
104999515,26cyclictest0-21swapper/320:31:573
104899513,10cyclictest0-21swapper/220:12:072
104799514,39cyclictest0-21swapper/119:11:511
104799514,29cyclictest0-21swapper/120:47:181
104799513,41cyclictest0-21swapper/120:41:581
104899505,9cyclictest0-21swapper/220:02:132
104899504,41cyclictest0-21swapper/222:08:182
104899504,27cyclictest0-21swapper/220:49:052
104899503,42cyclictest0-21swapper/222:49:072
104899503,39cyclictest0-21swapper/220:35:502
104899503,29cyclictest0-21swapper/220:07:262
1042995034,10cyclictest10675-21grep20:22:120
1042995020,13cyclictest0-21swapper/020:32:200
219499490,4rtkit-daemon2193-21rtkit-daemon19:07:132
178502492,9sleep20-21swapper/219:31:302
104899494,13cyclictest0-21swapper/223:17:102
104899494,13cyclictest0-21swapper/223:17:102
104899494,11cyclictest0-21swapper/200:25:232
1048994930,13cyclictest0-21swapper/221:36:562
104899493,28cyclictest0-21swapper/222:45:112
104899493,26cyclictest0-21swapper/223:36:442
104299494,28cyclictest0-21swapper/020:37:000
104299494,28cyclictest0-21swapper/020:37:000
104299494,28cyclictest0-21swapper/019:27:110
7452484,37sleep00-21swapper/018:53:440
200392482,39sleep20-21swapper/219:33:562
104899483,39cyclictest0-21swapper/220:27:132
104899483,26cyclictest0-21swapper/222:16:592
104799484,27cyclictest0-21swapper/119:22:051
104799483,40cyclictest0-21swapper/120:22:091
1047994819,14cyclictest0-21swapper/120:13:071
104299479,32cyclictest0-21swapper/019:37:110
104899463,7cyclictest25702-21munin-run20:56:452
104899463,26cyclictest0-21swapper/219:22:172
104299465,13cyclictest0-21swapper/019:22:010
89102452,9sleep20-21swapper/220:17:332
104899453,23cyclictest0-21swapper/220:21:582
1042994522,12cyclictest0-21swapper/019:47:180
104899443,12cyclictest0-21swapper/219:17:152
1048994424,13cyclictest0-21swapper/220:41:572
104299444,25cyclictest0-21swapper/020:53:180
104899434,23cyclictest16636-21munin-node20:36:572
104899434,23cyclictest16636-21munin-node20:36:572
104899434,13cyclictest0-21swapper/219:36:582
1048994315,13cyclictest0-21swapper/219:42:002
6592424,33sleep30-21swapper/318:52:383
104799424,12cyclictest0-21swapper/118:56:511
104899394,29cyclictest0-21swapper/218:56:512
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional