You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-20 - 03:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Mon Apr 20, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3201899934,9cyclictest1419-21runrttasks20:47:151
3201899923,72cyclictest28370-21fschecks_count22:25:051
3201899923,12cyclictest0-21swapper/122:22:141
3201899914,63cyclictest0-21swapper/122:15:061
3201899914,13cyclictest0-21swapper/121:01:261
3201899914,12cyclictest0-21swapper/119:24:241
3201899914,10cyclictest22496-21taskset21:29:131
3201899894,20cyclictest18764-21latency22:10:101
3201899894,13cyclictest0-21swapper/121:39:251
3201899894,13cyclictest0-21swapper/121:24:041
3201899894,13cyclictest0-21swapper/121:24:041
3201899894,12cyclictest0-21swapper/117:59:571
3201899893,66cyclictest1798-21latency_hist22:34:461
3201899893,64cyclictest0-21swapper/120:10:201
3201899887,8cyclictest19694-21ssh19:49:101
3201899884,13cyclictest0-21swapper/120:37:021
3201899884,13cyclictest0-21swapper/120:37:021
3201899884,12cyclictest0-21swapper/119:56:521
3201899884,12cyclictest0-21swapper/119:56:521
3201899874,66cyclictest0-21swapper/120:25:041
3201899874,63cyclictest0-21swapper/120:59:071
3201899874,13cyclictest0-21swapper/120:20:071
3201899874,12cyclictest0-21swapper/121:50:081
3201899874,12cyclictest0-21swapper/121:14:441
3201899874,12cyclictest0-21swapper/119:30:121
3201899873,10cyclictest4852-21aten_r1power_po17:20:101
3201899865,12cyclictest0-21swapper/121:06:101
3201899864,13cyclictest0-21swapper/121:30:081
3201899864,13cyclictest0-21swapper/120:00:161
3201899864,12cyclictest0-21swapper/122:03:271
3201899864,12cyclictest0-21swapper/122:03:271
32018998638,40cyclictest16063-21needreboot20:30:161
32018998614,54cyclictest121850irq/46-eth020:54:501
32018998614,51cyclictest0-21swapper/122:08:211
3201899854,72cyclictest1419-21runrttasks21:55:181
3201899854,72cyclictest1419-21runrttasks21:55:181
3201899854,59cyclictest0-21swapper/122:38:511
32018998512,7cyclictest24760-21diskmemload19:35:431
3201899844,62cyclictest0-21swapper/119:49:571
3201899844,62cyclictest0-21swapper/119:49:571
3201899844,14cyclictest0-21swapper/119:26:511
3201899844,13cyclictest0-21swapper/119:10:251
3201899844,13cyclictest0-21swapper/119:10:251
3201899843,10cyclictest13801-21grep19:40:061
248599840,18rtkit-daemon0-21swapper/221:34:162
3201899835,13cyclictest0-21swapper/121:45:131
3201899834,13cyclictest0-21swapper/118:06:471
3201899834,12cyclictest0-21swapper/121:42:551
3201899834,12cyclictest0-21swapper/120:40:021
3201899834,12cyclictest0-21swapper/119:05:041
3201899833,70cyclictest10185-21fschecks_time17:30:151
3201899825,13cyclictest0-21swapper/121:19:401
3201899824,14cyclictest0-21swapper/120:15:191
3201899824,14cyclictest0-21swapper/118:45:061
32018998220,54cyclictest7604-21unixbench_multi18:30:281
32018998220,54cyclictest7604-21unixbench_multi18:30:281
3201899814,68cyclictest19877-21gltestperf17:50:151
3201899814,60cyclictest0-21swapper/119:15:141
3201899814,56cyclictest0-21swapper/120:04:561
3201899814,13cyclictest0-21swapper/117:29:561
3201899805,15cyclictest0-21swapper/118:03:411
32018998021,51cyclictest5648-21latency_hist18:29:551
32018998021,51cyclictest5648-21latency_hist18:29:551
3201899794,13cyclictest0-21swapper/118:54:521
3201899794,10cyclictest3024-21fschecks_time17:15:151
32018997920,50cyclictest12692-21gltestperf17:35:141
32018997920,50cyclictest12406-21unixbench_singl18:40:271
3201899784,67cyclictest0-21swapper/117:45:261
32018997824,48cyclictest21083-21gltestperf19:00:141
3201899774,65cyclictest0-21swapper/118:55:191
3201899774,12cyclictest0-21swapper/117:10:141
32018997722,47cyclictest8887-21fschecks_count18:35:131
3201899764,9cyclictest30763-21crond18:14:541
3201899763,31cyclictest32009-21cyclictest17:09:571
32018997419,48cyclictest2427-21processes18:20:251
32018997415,52cyclictest15410-21missed_timers17:40:211
32018997415,52cyclictest15410-21missed_timers17:40:211
32018997322,44cyclictest31923-21hwlatdetect18:15:171
248599730,6rtkit-daemon0-21swapper/220:40:033
248599710,6rtkit-daemon0-21swapper/222:11:300
3202399704,28cyclictest0-21swapper/319:54:503
3202399704,28cyclictest0-21swapper/319:54:503
248599690,8rtkit-daemon0-21swapper/220:55:103
248599680,7rtkit-daemon0-21swapper/218:20:163
248599680,6rtkit-daemon0-21swapper/219:19:513
3202399673,12cyclictest0-21swapper/319:55:013
3202399673,12cyclictest0-21swapper/319:55:013
32015996751,11cyclictest0-21swapper/020:26:260
248599670,6rtkit-daemon0-21swapper/217:30:263
32023996617,33cyclictest0-21swapper/322:14:283
248599660,8rtkit-daemon0-21swapper/219:21:293
248599660,6rtkit-daemon0-21swapper/218:02:393
248599650,7rtkit-daemon0-21swapper/220:10:193
248599650,6rtkit-daemon0-21swapper/219:40:063
32015996433,13cyclictest0-21swapper/019:30:070
248599640,7rtkit-daemon0-21swapper/221:30:543
248599640,6rtkit-daemon26-21rcuc/221:26:013
3202399638,39cyclictest0-21swapper/320:09:243
3202399634,51cyclictest0-21swapper/322:30:143
3202399634,12cyclictest0-21swapper/321:54:583
3202399634,12cyclictest0-21swapper/321:54:583
32015996345,12cyclictest0-21swapper/022:00:160
32015996345,12cyclictest0-21swapper/022:00:160
32015996343,13cyclictest0-21swapper/020:00:250
32015996341,15cyclictest0-21swapper/020:05:060
248599630,6rtkit-daemon0-21swapper/220:25:193
248599630,6rtkit-daemon0-21swapper/217:40:183
248599630,6rtkit-daemon0-21swapper/217:40:183
248599630,5rtkit-daemon8464-21cpu18:35:083
248599630,5rtkit-daemon4401-21ntpq19:25:213
32015996247,10cyclictest0-21swapper/021:22:180
32015996247,10cyclictest0-21swapper/021:22:180
248599620,6rtkit-daemon0-21swapper/218:40:233
32015996141,13cyclictest0-21swapper/021:25:020
32015996141,12cyclictest0-21swapper/022:35:200
248599610,7rtkit-daemon0-21swapper/319:52:502
248599610,7rtkit-daemon0-21swapper/319:52:502
248599610,6rtkit-daemon0-21swapper/220:16:493
8812603,49sleep00-21swapper/022:31:380
3202399604,49cyclictest0-21swapper/320:52:403
32015996044,11cyclictest0-21swapper/020:51:560
32015996037,16cyclictest0-21swapper/020:44:540
3202399594,36cyclictest0-21swapper/319:35:083
3202299596,16cyclictest0-21swapper/221:29:472
3201599595,46cyclictest0-21swapper/020:55:060
3201599594,32cyclictest0-21swapper/021:14:550
248599590,6rtkit-daemon0-21swapper/217:50:473
248599590,5rtkit-daemon0-21swapper/217:57:553
3202399586,44cyclictest0-21swapper/321:50:493
3202299584,47cyclictest0-21swapper/222:19:452
3202299584,37cyclictest0-21swapper/220:00:142
32022995818,23cyclictest0-21swapper/219:15:122
256002583,11sleep20-21swapper/219:10:112
256002583,11sleep20-21swapper/219:10:112
248599580,6rtkit-daemon0-21swapper/221:41:463
234782584,12sleep00-21swapper/022:17:350
3202399575,38cyclictest0-21swapper/322:26:513
3202399575,37cyclictest0-21swapper/319:45:003
32023995715,28cyclictest623-21aten_r1power_en21:44:583
3201599574,46cyclictest0-21swapper/019:25:150
3201599574,45cyclictest0-21swapper/021:45:050
32015995737,13cyclictest0-21swapper/022:20:180
284732573,47sleep00-21swapper/021:36:270
248599570,5rtkit-daemon0-21swapper/218:59:003
121802572,48sleep20-21swapper/219:36:192
100502573,10sleep00-21swapper/019:35:000
49462563,13sleep00-21swapper/021:01:360
3202399564,13cyclictest0-21swapper/322:05:193
32023995621,12cyclictest0-21swapper/320:33:473
3202299564,46cyclictest0-21swapper/221:00:142
3202299564,35cyclictest0-21swapper/219:49:522
3201599564,44cyclictest0-21swapper/021:40:020
32015995636,13cyclictest0-21swapper/019:53:430
32015995636,13cyclictest0-21swapper/019:53:430
220292563,9sleep00-21swapper/019:00:450
192012563,11sleep00-21swapper/019:47:220
3202399555,36cyclictest0-21swapper/319:13:233
3202399555,36cyclictest0-21swapper/319:13:233
3202399554,36cyclictest0-21swapper/322:23:493
3202399554,34cyclictest0-21swapper/321:02:453
3202399553,39cyclictest24760-21diskmemload22:04:123
3202399553,39cyclictest24760-21diskmemload22:04:123
3202399553,34cyclictest0-21swapper/320:37:153
3202399553,34cyclictest0-21swapper/320:37:153
3202399553,26cyclictest0-21swapper/318:49:463
32023995523,13cyclictest0-21swapper/321:10:053
3202299554,35cyclictest0-21swapper/222:04:152
3202299554,35cyclictest0-21swapper/222:04:152
32015995535,13cyclictest0-21swapper/019:55:160
32015995535,13cyclictest0-21swapper/019:55:160
32015995535,13cyclictest0-21swapper/017:30:160
32015995533,14cyclictest0-21swapper/022:25:180
124462553,10sleep00-21swapper/021:14:220
106212553,45sleep224760-21diskmemload21:59:472
106212553,45sleep224760-21diskmemload21:59:472
89232543,8sleep31287-21snmpd17:25:363
85332543,44sleep00-21swapper/018:35:100
3202399544,37cyclictest0-21swapper/321:38:013
3202399544,29cyclictest0-21swapper/318:15:313
32023995435,12cyclictest28143-21needreboot20:00:163
3202399543,33cyclictest0-21swapper/320:45:383
32022995437,10cyclictest7606-21unixbench_multi18:30:282
32022995437,10cyclictest7606-21unixbench_multi18:30:282
3202299543,45cyclictest7071-21ssh21:54:122
3202299543,34cyclictest0-21swapper/220:30:062
3202299543,34cyclictest0-21swapper/220:13:472
32022995418,20cyclictest0-21swapper/222:09:192
32022995417,21cyclictest0-21swapper/220:21:342
32015995441,8cyclictest5662-21systemd-cgroups18:29:540
32015995441,8cyclictest5662-21systemd-cgroups18:29:540
32015995434,14cyclictest0-21swapper/017:19:570
32015995434,13cyclictest0-21swapper/020:10:000
32015995434,13cyclictest0-21swapper/018:20:090
32015995410,34cyclictest0-21swapper/021:54:570
32015995410,34cyclictest0-21swapper/021:54:570
233852543,9sleep00-21swapper/017:57:210
197632542,10sleep00-21swapper/018:57:190
3202399538,27cyclictest0-21swapper/319:32:213
3202399535,26cyclictest11187-21munin-run20:24:493
3202299535,30cyclictest0-21swapper/222:11:282
3202299534,44cyclictest0-21swapper/222:28:382
3202299534,36cyclictest0-21swapper/219:30:082
3202299534,32cyclictest0-21swapper/218:10:092
32022995316,21cyclictest0-21swapper/220:08:152
3201599534,42cyclictest0-21swapper/020:37:300
3201599534,42cyclictest0-21swapper/020:37:300
32015995334,13cyclictest0-21swapper/020:30:060
32015995333,13cyclictest0-21swapper/018:30:070
32015995333,13cyclictest0-21swapper/018:30:070
32015995333,13cyclictest0-21swapper/018:15:350
32015995332,14cyclictest0-21swapper/019:24:170
316752534,6sleep00-21swapper/017:05:550
267172533,43sleep226784-21vmstat20:45:252
186402533,44sleep00-21swapper/017:47:460
3202399525,28cyclictest0-21swapper/317:20:093
3202399525,27cyclictest0-21swapper/322:14:573
3202399524,28cyclictest0-21swapper/322:38:503
3202399524,28cyclictest0-21swapper/319:00:303
32023995220,13cyclictest0-21swapper/317:15:203
32023995220,12cyclictest0-21swapper/321:05:123
32023995220,12cyclictest0-21swapper/317:45:143
3202299524,28cyclictest0-21swapper/222:30:132
3202299523,42cyclictest0-21swapper/221:15:032
32022995214,32cyclictest281ktimersoftd/218:50:052
3201599525,40cyclictest0-21swapper/020:40:140
3201599524,41cyclictest0-21swapper/017:14:570
32015995238,10cyclictest0-21swapper/021:05:190
32015995218,29cyclictest0-21swapper/019:14:150
32015995218,29cyclictest0-21swapper/019:14:150
157332523,11sleep00-21swapper/022:05:170
154992523,42sleep00-21swapper/019:41:090
92162513,10sleep00-21swapper/017:29:240
76232513,8sleep26114-21munin-node21:05:212
3202399515,40cyclictest0-21swapper/321:15:103
3202399514,26cyclictest17594-21munin-run18:54:533
3202399514,15cyclictest0-21swapper/321:24:233
3202399514,15cyclictest0-21swapper/321:24:233
32023995117,12cyclictest0-21swapper/317:35:493
3202299517,27cyclictest0-21swapper/222:20:132
3202299514,31cyclictest0-21swapper/222:35:072
3202299514,29cyclictest0-21swapper/220:15:162
32022995128,10cyclictest0-21swapper/221:21:342
32022995128,10cyclictest0-21swapper/221:21:342
3202299512,42cyclictest31870-21ssh19:19:572
32022995116,21cyclictest0-21swapper/220:37:132
32022995116,21cyclictest0-21swapper/220:37:132
3201599515,38cyclictest0-21swapper/017:40:080
3201599515,38cyclictest0-21swapper/017:40:080
3201599514,40cyclictest0-21swapper/021:50:140
3201599514,28cyclictest0-21swapper/018:54:530
32015995133,12cyclictest0-21swapper/020:15:060
32015995132,13cyclictest0-21swapper/020:19:540
3201599512,44cyclictest0-21swapper/017:24:110
3202399504,28cyclictest0-21swapper/318:10:083
3202399504,28cyclictest0-21swapper/318:05:243
3202399504,27cyclictest0-21swapper/317:14:583
32023995019,13cyclictest0-21swapper/318:25:223
32023995019,13cyclictest0-21swapper/318:25:223
3202299505,28cyclictest0-21swapper/219:40:032
3202299504,40cyclictest0-21swapper/219:25:252
3202299504,28cyclictest0-21swapper/221:45:092
3202299504,28cyclictest0-21swapper/217:55:202
32022995034,10cyclictest12242-21tr17:35:092
3202299503,40cyclictest0-21swapper/217:30:322
32022995021,12cyclictest0-21swapper/219:55:152
32022995021,12cyclictest0-21swapper/219:55:152
3201599504,39cyclictest0-21swapper/018:05:140
32015995029,14cyclictest0-21swapper/018:00:140
32015995028,15cyclictest0-21swapper/017:35:130
314252503,9sleep00-21swapper/019:19:160
246062502,10sleep30-21swapper/319:08:023
44032493,39sleep24490-21if_eth018:25:172
44032493,39sleep24490-21if_eth018:25:172
3202299494,28cyclictest0-21swapper/220:57:552
3202299494,28cyclictest0-21swapper/220:25:042
3202299494,28cyclictest0-21swapper/217:45:202
3202299494,27cyclictest0-21swapper/221:40:092
3202299494,27cyclictest0-21swapper/221:10:002
3202299494,27cyclictest0-21swapper/217:15:232
3202299493,39cyclictest0-21swapper/220:40:072
32022994920,12cyclictest0-21swapper/221:35:122
3202299492,33cyclictest0-21swapper/217:25:142
32022994916,10cyclictest28720-21df20:50:042
3201599494,38cyclictest0-21swapper/019:05:040
3201599494,28cyclictest0-21swapper/021:32:230
307052493,40sleep00-21swapper/018:14:140
32023994819,13cyclictest0-21swapper/318:30:213
32023994819,13cyclictest0-21swapper/318:30:213
3202299484,28cyclictest0-21swapper/218:00:192
3202299484,27cyclictest0-21swapper/218:40:252
3202299484,27cyclictest0-21swapper/217:40:182
3202299484,27cyclictest0-21swapper/217:40:182
3202299484,26cyclictest0-21swapper/218:05:102
3202299483,27cyclictest0-21swapper/219:05:232
32022994820,12cyclictest0-21swapper/218:59:542
32015994830,11cyclictest19729-21tune2fs17:50:140
3202299474,26cyclictest0-21swapper/218:45:192
3202299474,26cyclictest0-21swapper/218:35:162
3202299473,27cyclictest0-21swapper/218:20:272
32022994720,12cyclictest0-21swapper/218:19:482
16772472,9sleep20-21swapper/217:11:082
3202299463,27cyclictest0-21swapper/219:00:092
32022994629,11cyclictest6478-21unixbench_singl17:20:312
32022994527,11cyclictest19388-21grep17:50:102
3201599454,33cyclictest0-21swapper/018:45:050
3201599453,26cyclictest0-21swapper/018:40:260
3202299413,12cyclictest0-21swapper/217:09:582
3202399389,20cyclictest0-21swapper/317:09:583
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional