You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-07 - 00:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Mon Jul 06, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
27356997913,59cyclictest41ktimersoftd/010:19:150
2735699744,64cyclictest0-21swapper/010:34:000
2736299734,61cyclictest0-21swapper/310:48:393
2736299724,61cyclictest0-21swapper/311:13:553
2735699704,58cyclictest0-21swapper/007:04:000
2736299695,54cyclictest12850-21munin-run11:33:373
146792680,2sleep2281ktimersoftd/210:48:262
2735699674,56cyclictest0-21swapper/009:44:140
2735699674,55cyclictest0-21swapper/009:29:120
2735699674,55cyclictest0-21swapper/008:54:110
10372673,11sleep10-21swapper/108:52:281
27362996648,12cyclictest0-21swapper/309:51:023
2735699665,53cyclictest0-21swapper/011:28:550
2735699664,55cyclictest0-21swapper/011:03:380
2735699664,54cyclictest0-21swapper/010:14:030
2735699664,54cyclictest0-21swapper/008:34:080
2735699664,54cyclictest0-21swapper/008:34:080
27362996530,20cyclictest24859-21ls10:14:063
27361996538,9cyclictest8628-21ssh09:03:432
2735699655,38cyclictest0-21swapper/010:25:180
2735699654,54cyclictest0-21swapper/011:18:590
2735699654,53cyclictest0-21swapper/011:48:540
2736299645,52cyclictest0-21swapper/309:28:573
2736299645,51cyclictest14387-21ssh09:58:593
2736299645,51cyclictest14387-21ssh09:58:593
2735699644,54cyclictest0-21swapper/009:03:110
2735699644,53cyclictest0-21swapper/010:39:060
2735699644,53cyclictest0-21swapper/010:39:060
2735699644,52cyclictest0-21swapper/011:14:420
2735699644,52cyclictest0-21swapper/009:58:550
2735699644,52cyclictest0-21swapper/009:58:550
2735699644,51cyclictest0-21swapper/011:24:120
2735699643,56cyclictest0-21swapper/011:53:560
2735699643,56cyclictest0-21swapper/011:53:560
2735699643,55cyclictest0-21swapper/011:44:390
2735699643,54cyclictest0-21swapper/010:29:120
255152643,13sleep20-21swapper/208:39:192
93332634,50sleep20-21swapper/208:09:082
2736299636,49cyclictest0-21swapper/308:54:103
2736299635,50cyclictest20921-21iostat_ios11:43:593
2736299635,50cyclictest20715-21taskset10:55:503
27361996338,11cyclictest0-21swapper/211:33:342
2736199633,52cyclictest0-21swapper/207:44:042
2735699635,51cyclictest0-21swapper/009:21:030
2735699635,49cyclictest18693-21cpuspeed_turbos10:53:520
2735699634,53cyclictest0-21swapper/008:50:540
2735699634,51cyclictest0-21swapper/009:09:390
2735699634,51cyclictest0-21swapper/008:39:010
27356996318,14cyclictest0-21swapper/012:01:420
2736299625,50cyclictest0-21swapper/310:37:143
2735699625,49cyclictest0-21swapper/011:04:010
2735699625,49cyclictest0-21swapper/009:04:140
2735699625,14cyclictest0-21swapper/009:55:270
2735699624,51cyclictest0-21swapper/011:34:080
2735699624,51cyclictest0-21swapper/010:52:470
2735699624,51cyclictest0-21swapper/009:35:490
2735699624,50cyclictest0-21swapper/008:09:070
2735699624,50cyclictest0-21swapper/006:58:480
2735699624,49cyclictest0-21swapper/009:48:580
2735699624,27cyclictest0-21swapper/009:23:570
27361996125,12cyclictest0-21swapper/209:06:212
2735699615,14cyclictest0-21swapper/007:23:470
2735699615,14cyclictest0-21swapper/007:23:470
2735699614,51cyclictest0-21swapper/010:47:140
2735699614,51cyclictest0-21swapper/009:16:250
2735699614,49cyclictest0-21swapper/007:13:590
2735699614,49cyclictest0-21swapper/006:38:490
2735699614,29cyclictest0-21swapper/008:28:560
60742603,49sleep10-21swapper/111:23:381
49282603,13sleep20-21swapper/211:19:272
2736299605,48cyclictest0-21swapper/309:14:473
2736299604,12cyclictest0-21swapper/311:18:523
27362996020,33cyclictest1227-21runrttasks08:04:333
27361996028,13cyclictest0-21swapper/211:28:382
2735699605,48cyclictest0-21swapper/007:53:590
2735699605,26cyclictest0-21swapper/010:08:590
2735699605,14cyclictest0-21swapper/010:06:140
2735699604,49cyclictest0-21swapper/009:39:570
2735699604,28cyclictest0-21swapper/006:44:030
2735699604,14cyclictest0-21swapper/008:43:500
2736299596,46cyclictest0-21swapper/311:09:203
2736299595,47cyclictest0-21swapper/311:56:203
2736299595,47cyclictest0-21swapper/311:56:203
2736299595,47cyclictest0-21swapper/311:50:363
2736299595,47cyclictest0-21swapper/309:27:323
2736299595,47cyclictest0-21swapper/308:48:383
27362995941,13cyclictest0-21swapper/309:05:243
2736299592,51cyclictest0-21swapper/310:04:213
27361995930,10cyclictest1124-21snmpd10:06:572
2735699595,48cyclictest0-21swapper/011:12:000
2735699594,48cyclictest0-21swapper/011:39:100
2735699594,30cyclictest0-21swapper/008:16:380
27362995841,12cyclictest0-21swapper/309:09:003
27362995839,13cyclictest0-21swapper/312:03:183
27361995821,24cyclictest0-21swapper/211:44:442
27361995815,35cyclictest2715-21gltestperf08:54:032
2735699584,27cyclictest0-21swapper/008:21:390
2736299575,46cyclictest0-21swapper/309:55:313
2736299575,45cyclictest0-21swapper/311:27:023
27362995740,11cyclictest1547-21nscd06:39:023
2736299574,10cyclictest4020-21df_inode09:43:573
27362995739,13cyclictest0-21swapper/306:34:293
2736299573,10cyclictest0-21swapper/310:09:403
2736299572,49cyclictest0-21swapper/308:40:423
2736199574,13cyclictest0-21swapper/210:48:552
2736199573,13cyclictest0-21swapper/210:59:092
27361995727,12cyclictest0-21swapper/209:38:502
27360995739,12cyclictest0-21swapper/108:38:211
27360995739,12cyclictest0-21swapper/108:38:211
2735699573,33cyclictest0-21swapper/007:28:190
290502563,7sleep129168-21cat06:34:271
2736299565,44cyclictest0-21swapper/309:20:393
27362995641,9cyclictest27633-21sshd10:18:563
2736299564,46cyclictest0-21swapper/310:59:023
2736299564,45cyclictest0-21swapper/308:49:103
2736299564,45cyclictest0-21swapper/308:34:023
2736299564,45cyclictest0-21swapper/308:34:023
27362995638,13cyclictest0-21swapper/309:00:263
27362995623,12cyclictest7358-21kworker/3:011:34:033
2736199564,34cyclictest0-21swapper/211:13:312
2736199564,15cyclictest0-21swapper/209:36:592
27361995632,9cyclictest9968-21cpuspeed_turbos07:04:012
27361995630,12cyclictest0-21swapper/208:29:082
2736199563,12cyclictest0-21swapper/209:32:242
27361995629,8cyclictest22328-21ssh08:35:012
27361995629,8cyclictest22328-21ssh08:35:012
27361995628,13cyclictest0-21swapper/211:48:552
27361995626,12cyclictest0-21swapper/210:28:592
27356995623,14cyclictest0-21swapper/008:04:000
223492562,10sleep20-21swapper/210:09:532
2736299554,27cyclictest0-21swapper/310:33:003
27362995539,11cyclictest0-21swapper/310:49:013
27362995538,11cyclictest0-21swapper/306:54:033
2736199554,12cyclictest0-21swapper/209:14:012
27361995531,7cyclictest8249-21ssh10:38:472
27361995531,7cyclictest8249-21ssh10:38:472
2736199553,14cyclictest0-21swapper/210:54:002
2736099555,34cyclictest0-21swapper/111:54:521
2736099555,34cyclictest0-21swapper/111:54:521
27360995528,13cyclictest0-21swapper/111:08:491
27362995438,10cyclictest17271-21fschecks_time11:38:563
2736299543,28cyclictest0-21swapper/309:38:563
27362995422,14cyclictest0-21swapper/307:16:293
2736299542,47cyclictest0-21swapper/309:34:033
2736299542,46cyclictest0-21swapper/308:18:023
27362995415,22cyclictest0-21swapper/310:39:013
27362995415,22cyclictest0-21swapper/310:39:013
2736199543,13cyclictest0-21swapper/209:24:052
27361995426,13cyclictest0-21swapper/208:51:502
2736099543,27cyclictest0-21swapper/110:51:431
27360995413,26cyclictest0-21swapper/109:29:421
253032543,44sleep20-21swapper/211:03:512
219499540,5rtkit-daemon2193-21rtkit-daemon10:24:022
219499540,5rtkit-daemon2193-21rtkit-daemon10:14:032
157342542,9sleep20-21swapper/210:00:222
157342542,9sleep20-21swapper/210:00:222
27362995335,13cyclictest0-21swapper/311:06:523
2736299532,27cyclictest0-21swapper/306:33:493
27361995331,8cyclictest14130-21yum-updatesd-he07:13:482
27361995331,8cyclictest14130-21yum-updatesd-he07:13:482
2736199533,8cyclictest1227-21runrttasks11:18:322
27361995325,12cyclictest0-21swapper/208:28:452
27360995330,11cyclictest0-21swapper/110:29:141
27360995323,12cyclictest0-21swapper/108:59:021
27360995320,7cyclictest32501-21sshd10:24:561
27360995315,23cyclictest30071-21latency09:34:041
27356995321,15cyclictest0-21swapper/006:39:010
219499530,5rtkit-daemon2193-21rtkit-daemon10:34:022
219499530,5rtkit-daemon2193-21rtkit-daemon10:19:022
2736299527,29cyclictest0-21swapper/307:36:323
2736299526,30cyclictest0-21swapper/306:49:223
2736299525,29cyclictest0-21swapper/307:39:073
2736299525,28cyclictest0-21swapper/308:01:363
2736299525,28cyclictest0-21swapper/308:01:363
27362995238,9cyclictest29042-21cut07:44:013
27362995222,13cyclictest0-21swapper/307:06:283
2736199525,24cyclictest0-21swapper/209:51:372
2736199524,41cyclictest0-21swapper/211:38:542
2736199524,41cyclictest0-21swapper/209:43:542
2736199523,30cyclictest0-21swapper/209:13:402
2736199523,11cyclictest0-21swapper/209:55:342
27361995228,9cyclictest18950-21aten2.4-expect09:18:542
27361995225,12cyclictest0-21swapper/211:54:102
27361995225,12cyclictest0-21swapper/211:54:102
2736099524,41cyclictest0-21swapper/111:43:471
2736099524,26cyclictest0-21swapper/109:45:131
2736099523,42cyclictest0-21swapper/112:01:131
2736099523,28cyclictest0-21swapper/106:39:031
2735699524,32cyclictest0-21swapper/006:49:090
2735699523,34cyclictest0-21swapper/007:28:500
159212522,9sleep20-21swapper/211:37:332
127532523,11sleep312853-21gltestperf07:09:073
127532523,11sleep312853-21gltestperf07:09:073
2736299514,28cyclictest0-21swapper/308:13:463
2736299514,28cyclictest0-21swapper/306:44:083
2736299514,27cyclictest0-21swapper/307:26:313
2736299513,11cyclictest1227-21runrttasks07:01:043
2736199515,38cyclictest0-21swapper/206:54:052
2736099514,29cyclictest0-21swapper/111:04:071
2736099514,29cyclictest0-21swapper/109:04:181
27360995130,14cyclictest0-21swapper/109:59:241
27360995130,14cyclictest0-21swapper/109:59:241
27360995124,20cyclictest16817-21proc_pri09:14:101
27360995124,12cyclictest0-21swapper/107:09:001
27360995124,12cyclictest0-21swapper/107:09:001
27360995122,13cyclictest0-21swapper/110:08:511
2735699515,29cyclictest0-21swapper/007:39:040
2735699515,29cyclictest0-21swapper/007:34:120
2735699514,28cyclictest0-21swapper/008:24:210
2735699514,27cyclictest0-21swapper/006:33:500
2735699514,25cyclictest0-21swapper/007:11:280
2735699514,25cyclictest0-21swapper/007:11:280
151552512,10sleep30-21swapper/308:21:553
74722503,41sleep10-21swapper/110:36:491
2736299506,27cyclictest0-21swapper/307:54:043
2736299505,28cyclictest0-21swapper/307:21:303
2736299505,28cyclictest0-21swapper/307:21:303
2736299504,28cyclictest0-21swapper/307:29:053
27362995012,12cyclictest0-21swapper/310:24:103
2736199504,30cyclictest0-21swapper/211:58:502
27361995025,11cyclictest0-21swapper/206:44:072
27361995020,13cyclictest0-21swapper/208:47:102
2736099506,24cyclictest0-21swapper/111:51:461
2736099505,38cyclictest0-21swapper/108:44:071
2736099504,32cyclictest0-21swapper/109:08:511
2736099504,28cyclictest0-21swapper/110:13:431
27360995031,13cyclictest0-21swapper/110:45:381
27360995026,11cyclictest0-21swapper/111:13:571
27360995012,9cyclictest27271-21cpuspeed10:18:531
2735699504,28cyclictest0-21swapper/007:48:460
27356995013,14cyclictest0-21swapper/007:59:160
27356995013,14cyclictest0-21swapper/007:59:160
199392502,9sleep10-21swapper/108:31:521
173712502,9sleep30-21swapper/308:24:413
93092492,41sleep10-21swapper/107:03:001
2736299494,14cyclictest0-21swapper/307:49:163
2736199493,40cyclictest0-21swapper/207:19:042
2736199493,40cyclictest0-21swapper/207:19:042
2736099495,22cyclictest0-21swapper/108:38:471
2736099494,27cyclictest0-21swapper/106:54:191
2736099494,26cyclictest0-21swapper/111:37:021
2736099494,26cyclictest0-21swapper/109:42:091
2736099494,25cyclictest0-21swapper/108:54:141
2736099493,27cyclictest0-21swapper/107:14:431
27360994929,14cyclictest0-21swapper/110:54:121
27360994923,12cyclictest0-21swapper/111:28:491
27360994920,13cyclictest0-21swapper/106:44:101
27356994915,15cyclictest0-21swapper/007:01:270
27356994914,13cyclictest0-21swapper/007:49:020
212802492,41sleep10-21swapper/109:21:231
6052482,39sleep10-21swapper/107:51:171
2736299485,34cyclictest0-21swapper/308:28:563
2736199484,26cyclictest0-21swapper/208:04:072
27361994822,12cyclictest0-21swapper/207:38:062
27361994821,12cyclictest0-21swapper/207:03:472
27361994818,13cyclictest0-21swapper/207:39:222
2736099484,37cyclictest0-21swapper/108:03:591
2736099484,27cyclictest0-21swapper/110:58:551
2736099484,27cyclictest0-21swapper/108:19:191
2736099484,27cyclictest0-21swapper/107:24:041
2736099484,25cyclictest0-21swapper/110:04:071
2736099484,25cyclictest0-21swapper/109:51:151
2736099483,27cyclictest0-21swapper/111:39:121
27360994826,8cyclictest9202-21hwlatdetect10:38:571
27360994826,8cyclictest9202-21hwlatdetect10:38:571
27360994826,17cyclictest0-21swapper/107:44:591
221832482,9sleep10-21swapper/109:23:491
174072482,40sleep10-21swapper/108:24:551
294342472,9sleep20-21swapper/206:35:042
282132472,39sleep10-21swapper/107:40:131
2736199474,36cyclictest0-21swapper/207:23:552
2736199473,39cyclictest0-21swapper/206:49:002
2736199472,38cyclictest15306-21latency_hist08:23:452
2736099473,25cyclictest0-21swapper/107:33:571
27360994723,8cyclictest13287-21ssh09:58:401
27360994723,18cyclictest8467-21rm11:24:581
225842472,9sleep20-21swapper/207:29:102
27361994631,9cyclictest1931-21grep07:54:042
27361994628,11cyclictest11128-21cpuspeed_turbos08:13:592
27361994626,13cyclictest0-21swapper/207:14:012
2736099464,15cyclictest0-21swapper/107:29:131
126852462,9sleep10-21swapper/108:15:481
43942452,9sleep10-21swapper/106:51:111
27361994528,11cyclictest30282-21tr06:39:042
27360994532,7cyclictest10732-21latency_hist08:13:461
2736099453,38cyclictest0-21swapper/107:20:281
2736099453,38cyclictest0-21swapper/107:20:281
27361994429,10cyclictest31200-21aten_r1power_fr07:48:582
27361994422,10cyclictest0-21swapper/208:00:082
27361994422,10cyclictest0-21swapper/208:00:082
27360994429,9cyclictest5293-21unixbench_multi07:59:191
27360994429,9cyclictest5293-21unixbench_multi07:59:191
27360994316,11cyclictest0-21swapper/107:54:051
2736099423,31cyclictest0-21swapper/106:33:491
2736099420,8cyclictest10636-21iostat_ios07:04:091
266792376,20sleep226837-21grep06:29:172
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional