You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-25 - 16:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Thu Jun 25, 2026 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2194991630,7rtkit-daemon0-21swapper/110:42:462
288919910840,45cyclictest0-21swapper/011:55:440
28891991064,12cyclictest21627-21diskmemload09:55:590
2262321020,3sleep2281ktimersoftd/210:14:322
288919910127,58cyclictest0-21swapper/010:39:180
288919910016,15cyclictest0-21swapper/012:03:570
28891999926,57cyclictest0-21swapper/011:19:260
28891999826,52cyclictest0-21swapper/010:14:180
219499980,5rtkit-daemon2193-21rtkit-daemon09:29:191
219499980,5rtkit-daemon2193-21rtkit-daemon09:29:191
2889199977,7cyclictest107550irq/46-eth009:36:410
2889199976,72cyclictest0-21swapper/012:12:350
2889199976,72cyclictest0-21swapper/012:12:350
2889399964,51cyclictest0-21swapper/207:24:372
2889399964,51cyclictest0-21swapper/207:24:372
28891999618,13cyclictest0-21swapper/010:01:550
28894999528,15cyclictest0-21swapper/311:14:203
2889299954,82cyclictest0-21swapper/108:44:551
2889199955,26cyclictest0-21swapper/009:19:040
28891999526,54cyclictest0-21swapper/011:42:310
28891999526,51cyclictest0-21swapper/011:14:160
28891999524,52cyclictest0-21swapper/008:54:250
28891999523,52cyclictest0-21swapper/008:39:380
28891999522,51cyclictest0-21swapper/010:24:280
2889299944,83cyclictest0-21swapper/111:23:581
2889299944,83cyclictest0-21swapper/109:43:001
2889299943,84cyclictest0-21swapper/111:44:551
28891999437,50cyclictest0-21swapper/011:29:540
28891999421,9cyclictest2724-21ssh12:04:220
28891999421,9cyclictest25361-21ssh11:50:320
28891999410,10cyclictest107550irq/46-eth010:09:360
28894999315,13cyclictest0-21swapper/310:24:323
2889299934,81cyclictest0-21swapper/110:19:281
2889299933,82cyclictest0-21swapper/111:14:151
2889199934,23cyclictest25615-21grep11:04:330
2889199933,79cyclictest0-21swapper/009:44:230
28891999321,8cyclictest107550irq/46-eth009:09:220
28891999320,8cyclictest11286-21ssh10:44:290
28891999320,12cyclictest0-21swapper/009:05:070
28891999317,13cyclictest0-21swapper/011:36:300
28891999317,13cyclictest0-21swapper/011:36:300
28891999317,13cyclictest0-21swapper/011:00:230
2889299923,8cyclictest6505-21gltestperf11:24:181
2889299923,11cyclictest0-21swapper/111:54:241
2889199926,80cyclictest0-21swapper/009:53:030
28891999223,12cyclictest16035-21ntp_kernel_pll_09:19:290
28891999217,12cyclictest13626-21sshd07:19:180
28891999217,10cyclictest222681ssh09:29:190
28891999217,10cyclictest222681ssh09:29:190
28891999215,64cyclictest0-21swapper/011:13:070
28894999121,14cyclictest0-21swapper/310:14:303
28894999114,13cyclictest0-21swapper/309:09:213
2889199916,78cyclictest0-21swapper/009:01:230
2889199914,80cyclictest0-21swapper/009:41:050
28891999134,49cyclictest0-21swapper/010:49:500
28891999127,8cyclictest18462-21ssh10:54:310
28891999115,10cyclictest8830-21turbostat11:28:580
2889299907,8cyclictest7150irq/45-ahci10:44:011
2889299904,80cyclictest0-21swapper/109:48:131
2889299903,11cyclictest0-21swapper/109:09:231
28891999027,56cyclictest0-21swapper/007:14:300
28891999021,11cyclictest2758-21munin-node10:34:210
28891999018,11cyclictest0-21swapper/010:04:240
28891999017,12cyclictest0-21swapper/008:50:350
28891999017,12cyclictest0-21swapper/008:50:350
2889499894,30cyclictest0-21swapper/308:59:053
2889499894,28cyclictest0-21swapper/309:34:023
2889499894,28cyclictest0-21swapper/309:34:023
2889499893,25cyclictest30292-21aten_r1power_fr11:59:083
2889299894,79cyclictest0-21swapper/111:06:001
2889299894,78cyclictest0-21swapper/110:33:341
2889299893,78cyclictest0-21swapper/110:04:061
2889199895,77cyclictest0-21swapper/009:28:460
2889199894,65cyclictest0-21swapper/010:19:130
2889199894,27cyclictest0-21swapper/010:34:000
2889199894,24cyclictest0-21swapper/011:44:130
2889199893,24cyclictest0-21swapper/008:44:200
2889499884,77cyclictest0-21swapper/309:59:243
28894998827,11cyclictest0-21swapper/311:00:183
28894998822,12cyclictest0-21swapper/308:11:163
28894998822,12cyclictest0-21swapper/308:11:163
2889299884,51cyclictest0-21swapper/110:00:551
2889299883,11cyclictest0-21swapper/110:51:461
2889299883,11cyclictest0-21swapper/109:04:281
28892998813,51cyclictest0-21swapper/108:53:061
28892998813,51cyclictest0-21swapper/108:53:061
2889199884,77cyclictest0-21swapper/008:34:330
2889199884,77cyclictest0-21swapper/008:04:060
2889199884,25cyclictest0-21swapper/008:14:380
2889499873,27cyclictest0-21swapper/311:05:033
28894998724,14cyclictest0-21swapper/310:23:273
2889299874,76cyclictest0-21swapper/111:38:371
2889299874,76cyclictest0-21swapper/111:38:371
2889299873,8cyclictest21627-21diskmemload11:29:101
2889299873,10cyclictest1227-21runrttasks10:26:041
28891998725,57cyclictest0-21swapper/008:29:210
28891998714,13cyclictest0-21swapper/007:49:200
28894998631,9cyclictest21182-21unixbench_multi08:39:393
28894998626,8cyclictest2724-21ssh12:04:223
28894998621,13cyclictest0-21swapper/311:56:413
28894998615,12cyclictest0-21swapper/311:23:383
28894998615,12cyclictest0-21swapper/309:54:023
28894998615,10cyclictest7150irq/45-ahci08:24:053
2889299868,53cyclictest0-21swapper/109:22:121
2889299864,74cyclictest0-21swapper/112:09:141
2889299864,74cyclictest0-21swapper/112:09:141
2889299863,8cyclictest1227-21runrttasks10:10:001
2889299863,76cyclictest0-21swapper/109:17:121
28892998613,67cyclictest5147-21timerandwakeup09:49:341
28891998618,13cyclictest0-21swapper/007:34:200
28891998617,12cyclictest5706-21df_abs08:09:210
28891998617,12cyclictest5706-21df_abs08:09:210
2889499853,27cyclictest0-21swapper/310:49:223
2889299854,74cyclictest0-21swapper/111:10:291
2889299854,74cyclictest0-21swapper/108:39:311
2889299853,74cyclictest0-21swapper/109:01:551
2889199855,28cyclictest0-21swapper/007:01:560
2889499844,27cyclictest0-21swapper/311:39:103
2889499844,11cyclictest0-21swapper/308:44:283
28894998432,9cyclictest935-21ls09:44:253
28894998430,9cyclictest27017-21unixbench_multi09:34:363
28894998421,12cyclictest0-21swapper/310:05:033
2889299844,72cyclictest0-21swapper/110:54:181
2889299844,7cyclictest21627-21diskmemload12:04:221
2889299843,9cyclictest997-21awk12:03:561
2889199844,16cyclictest0-21swapper/007:04:250
28891998420,12cyclictest0-21swapper/006:44:100
2889499834,28cyclictest0-21swapper/311:44:073
2889499833,25cyclictest28129-21fschecks_time11:09:163
28894998327,10cyclictest7553-21aten_r1power_cu08:14:173
28894998324,12cyclictest0-21swapper/312:11:473
28894998324,12cyclictest0-21swapper/312:11:473
28894998323,12cyclictest0-21swapper/309:15:173
2889299834,73cyclictest0-21swapper/111:52:061
2889299833,72cyclictest0-21swapper/110:48:501
2889299833,10cyclictest0-21swapper/110:15:481
2889299832,9cyclictest13652-21aten2.4-expect07:19:191
28891998319,12cyclictest0-21swapper/006:49:210
28894998235,10cyclictest30490-21munin-node09:39:343
28894998231,9cyclictest953-21grep08:59:243
28894998229,10cyclictest5192-21needreboot06:59:333
2889299824,59cyclictest31390-21cat06:49:101
2889199825,15cyclictest0-21swapper/007:24:330
2889199825,15cyclictest0-21swapper/007:24:330
2889199823,23cyclictest0-21swapper/006:56:550
28891998227,48cyclictest0-21swapper/006:44:340
28891998218,12cyclictest0-21swapper/007:39:270
219499820,6rtkit-daemon31889-21cat07:54:370
2889499814,34cyclictest0-21swapper/309:54:563
28894998134,9cyclictest20818-21telnet07:34:193
2889499813,8cyclictest6903-21ssh09:07:513
2889499813,33cyclictest17569-21perl10:54:173
2889499813,13cyclictest0-21swapper/311:29:093
28894998125,12cyclictest0-21swapper/310:35:003
2889499812,10cyclictest0-21swapper/308:49:203
2889499812,10cyclictest0-21swapper/308:49:203
2889299814,9cyclictest13302-21munin-run07:19:071
2889299813,11cyclictest0-21swapper/111:39:001
2889199816,23cyclictest0-21swapper/008:19:390
2889199813,27cyclictest0-21swapper/008:24:170
2889199813,20cyclictest27632-21latency_hist07:49:070
2889499804,33cyclictest0-21swapper/310:30:413
28894998016,12cyclictest0-21swapper/306:44:103
2889299804,9cyclictest25518-21ssh09:34:161
2889299803,10cyclictest0-21swapper/111:02:381
2889199804,69cyclictest0-21swapper/008:04:370
2889299793,68cyclictest0-21swapper/108:54:311
2889299793,11cyclictest0-21swapper/107:59:351
2889299793,10cyclictest23985-21which07:39:261
2889199793,21cyclictest19241-21sort07:29:280
28891997922,9cyclictest9143-21cstates07:09:200
2889499786,21cyclictest0-21swapper/309:19:143
2889499784,34cyclictest3177-21df08:04:203
28894997825,7cyclictest21627-21diskmemload09:24:133
28894997822,11cyclictest0-21swapper/310:44:113
28894997816,19cyclictest0-21swapper/311:24:333
2889299783,9cyclictest9911-21munin-node08:19:261
2889299783,8cyclictest32210-21chrt07:56:301
2889299783,8cyclictest1579-21cut06:54:201
2889299783,10cyclictest3676-21smartctl10:34:201
2889299782,10cyclictest18668-21df_abs09:24:171
2889299774,50cyclictest0-21swapper/107:44:251
2889299774,11cyclictest0-21swapper/108:24:181
2889299773,9cyclictest7384-21munin-node09:54:161
2889299773,9cyclictest3718-21if_err_eth008:04:261
2889299773,9cyclictest1-21systemd07:24:191
2889299773,9cyclictest1-21systemd07:24:191
2889299773,67cyclictest0-21swapper/107:54:071
2889299773,67cyclictest0-21swapper/106:59:291
28894997630,7cyclictest8999-21ssh10:42:133
2889299764,64cyclictest0-21swapper/106:49:351
2889299763,10cyclictest0-21swapper/107:04:321
28894997527,8cyclictest20300-21ssh10:12:383
2889299753,10cyclictest0-21swapper/107:30:561
28892997513,48cyclictest0-21swapper/108:14:181
28894997426,7cyclictest23130-21ssh11:49:033
28894997423,8cyclictest32648-21munin-node07:59:273
2889499742,11cyclictest0-21swapper/307:06:573
2889299744,54cyclictest0-21swapper/107:14:081
2889299743,11cyclictest0-21swapper/107:34:381
2889299743,10cyclictest0-21swapper/108:34:151
2889499732,11cyclictest0-21swapper/311:36:133
2889499732,11cyclictest0-21swapper/311:36:133
2889299733,63cyclictest0-21swapper/106:44:101
2889299733,11cyclictest0-21swapper/108:29:381
28894997124,10cyclictest29115-21munin-node06:44:213
2889299713,11cyclictest0-21swapper/108:09:161
2889299713,11cyclictest0-21swapper/108:09:161
28894996728,9cyclictest8760-21munin-node07:09:373
28894996724,9cyclictest23093-21munin-node07:39:273
2889399665,53cyclictest0-21swapper/209:44:172
2889399646,50cyclictest17909-21ssh10:09:142
2889399636,50cyclictest25582-21iostat_ios10:19:232
189212638,7sleep20-21swapper/211:42:292
2889399615,49cyclictest0-21swapper/212:04:142
2889399605,48cyclictest0-21swapper/211:33:502
2889399605,48cyclictest0-21swapper/211:28:432
28893996013,41cyclictest2263-21fschecks_count06:54:252
2889399596,45cyclictest19972-21ssh09:24:352
2889399593,38cyclictest0-21swapper/209:09:392
2889399585,15cyclictest0-21swapper/208:44:202
2889399584,48cyclictest0-21swapper/211:14:212
2889399584,48cyclictest0-21swapper/211:09:232
2889399584,11cyclictest10586-21fschecks_time10:44:182
279752582,10sleep20-21swapper/209:37:252
259432583,46sleep20-21swapper/211:05:162
2889399575,45cyclictest0-21swapper/211:52:022
2889399574,47cyclictest0-21swapper/210:59:282
2889399574,47cyclictest0-21swapper/210:04:382
2889399574,45cyclictest0-21swapper/208:58:032
28893995710,27cyclictest0-21swapper/211:54:162
28894995633,10cyclictest1124-21snmpd07:32:003
2889399565,45cyclictest0-21swapper/211:47:562
2889399565,12cyclictest0-21swapper/210:58:382
2889399564,45cyclictest0-21swapper/211:59:162
28893995626,11cyclictest0-21swapper/210:49:262
2889499554,43cyclictest0-21swapper/307:23:413
2889399554,46cyclictest0-21swapper/210:35:562
2889399554,28cyclictest0-21swapper/209:15:572
28893995537,13cyclictest0-21swapper/211:19:082
28893995513,13cyclictest0-21swapper/209:49:142
2889399548,26cyclictest1227-21runrttasks12:09:432
2889399548,26cyclictest1227-21runrttasks12:09:432
2889399545,11cyclictest0-21swapper/209:59:112
2889399544,42cyclictest28744-21ssh08:54:052
2889399544,34cyclictest0-21swapper/209:40:072
2889399544,15cyclictest0-21swapper/209:19:202
28893995423,13cyclictest0-21swapper/208:14:062
28893995423,13cyclictest0-21swapper/208:14:062
28893995420,25cyclictest0-21swapper/209:54:152
2889399542,25cyclictest0-21swapper/209:32:122
2889399542,25cyclictest0-21swapper/209:32:122
204512547,40sleep20-21swapper/207:34:072
143402543,11sleep20-21swapper/208:27:442
28894995331,7cyclictest14449-21latency_hist08:29:053
2889399535,28cyclictest0-21swapper/210:29:262
2889399534,12cyclictest0-21swapper/208:04:322
28893995338,9cyclictest17807-21tune2fs08:34:222
28893995335,10cyclictest26089-21grep08:49:232
28893995320,12cyclictest0-21swapper/208:59:292
28894995229,8cyclictest16940-21iostat07:24:293
28894995229,8cyclictest16940-21iostat07:24:293
2889399526,28cyclictest0-21swapper/210:24:352
2889399525,27cyclictest0-21swapper/208:14:172
2889399524,12cyclictest0-21swapper/209:04:202
28893995237,9cyclictest11904-21grep07:14:272
2889399523,10cyclictest0-21swapper/207:59:402
28893995222,13cyclictest0-21swapper/207:54:242
28893995222,13cyclictest0-21swapper/207:09:212
28893995219,13cyclictest13524-21hddtemp_smartct11:34:172
28893995219,13cyclictest13524-21hddtemp_smartct11:34:172
28893995211,22cyclictest0-21swapper/206:49:192
2889499513,29cyclictest0-21swapper/306:54:413
28894995129,9cyclictest27896-21telnet07:49:183
2889399516,26cyclictest0-21swapper/207:19:202
2889399514,13cyclictest0-21swapper/207:34:242
2889399512,25cyclictest0-21swapper/207:40:172
2889499502,12cyclictest0-21swapper/306:53:283
2889399506,26cyclictest0-21swapper/207:52:042
2889399505,26cyclictest0-21swapper/207:06:572
28893995016,13cyclictest0-21swapper/207:01:562
28894994924,9cyclictest26231-21perl07:44:253
2889399495,27cyclictest0-21swapper/208:39:312
2889399495,26cyclictest0-21swapper/208:29:272
2889399494,27cyclictest0-21swapper/207:44:372
2889399494,24cyclictest12073-21munin-run08:24:052
28893994918,13cyclictest0-21swapper/206:45:212
28894994827,9cyclictest11312-21telnet07:14:223
2889399484,27cyclictest0-21swapper/206:44:102
2889499472,12cyclictest0-21swapper/308:35:543
28894994626,7cyclictest31433-21sed07:54:303
2889499462,11cyclictest0-21swapper/308:30:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional