You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-26 - 15:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Sun Apr 26, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1819721260,3sleep041ktimersoftd/008:03:580
271992930,7chrt0-21swapper/107:29:041
48772900,15sleep21605299cyclictest10:08:122
248599890,5rtkit-daemon2484-21rtkit-daemon08:19:150
16044997039,18cyclictest0-21swapper/009:38:520
16052996840,12cyclictest0-21swapper/210:11:042
16044996845,11cyclictest0-21swapper/009:53:560
16044996844,9cyclictest5890-21taskset09:19:470
16044996844,9cyclictest5890-21taskset09:19:470
16044996839,13cyclictest0-21swapper/009:03:410
1605299674,54cyclictest0-21swapper/208:49:042
16044996744,13cyclictest0-21swapper/007:17:150
16044996744,13cyclictest0-21swapper/007:17:150
16044996743,12cyclictest0-21swapper/009:58:510
16044996743,12cyclictest0-21swapper/009:58:510
16053996618,25cyclictest9114-21open_files07:49:133
16052996635,14cyclictest0-21swapper/207:44:022
16044996639,11cyclictest12155-21sshd07:08:280
16044996638,12cyclictest0-21swapper/008:43:440
1605399653,39cyclictest26316-21awk09:03:553
1605399652,40cyclictest0-21swapper/309:01:463
16053996515,27cyclictest0-21swapper/308:56:023
16044996542,11cyclictest0-21swapper/005:44:010
16044996541,14cyclictest0-21swapper/005:53:490
16044996541,14cyclictest0-21swapper/005:53:490
16044996539,14cyclictest0-21swapper/008:46:270
16044996539,12cyclictest0-21swapper/006:14:190
16052996435,13cyclictest0-21swapper/209:29:142
16044996441,13cyclictest0-21swapper/009:14:100
1604499644,53cyclictest22232-21hwlatdetect08:09:050
16044996439,13cyclictest0-21swapper/008:33:000
16044996438,13cyclictest0-21swapper/007:22:040
16044996438,10cyclictest1419-21runrttasks09:53:400
1605399634,37cyclictest0-21swapper/308:48:573
16052996343,7cyclictest6955-21ssh08:34:062
16052996340,10cyclictest0-21swapper/207:09:002
1605299634,51cyclictest0-21swapper/209:53:562
16044996341,12cyclictest0-21swapper/007:29:110
16044996340,12cyclictest0-21swapper/009:07:450
1604499634,35cyclictest0-21swapper/007:33:590
16044996336,12cyclictest0-21swapper/010:09:110
16044996336,12cyclictest0-21swapper/008:18:430
16044996336,10cyclictest7284-21aten2.4-expect09:23:530
1605399625,15cyclictest24047-21yum-updatesd-he09:48:563
1605299624,50cyclictest0-21swapper/209:39:172
16052996237,11cyclictest0-21swapper/209:59:132
16052996237,11cyclictest0-21swapper/209:59:132
1604499625,51cyclictest0-21swapper/008:34:110
16044996248,8cyclictest10949-21grep09:28:550
16044996241,10cyclictest10928-21fschecks_count05:59:080
16044996240,13cyclictest0-21swapper/007:11:380
1604499624,51cyclictest0-21swapper/010:04:160
1605399615,28cyclictest0-21swapper/309:08:593
1605299615,49cyclictest0-21swapper/207:54:022
1605299615,49cyclictest0-21swapper/207:54:022
1605299614,50cyclictest0-21swapper/207:18:462
1605299614,50cyclictest0-21swapper/207:18:462
16052996139,10cyclictest0-21swapper/205:34:192
16052996133,13cyclictest0-21swapper/209:36:492
16052996132,12cyclictest0-21swapper/209:44:092
1605299613,51cyclictest0-21swapper/208:07:452
1605299613,49cyclictest7739-21yum-updatesd-he07:48:562
16050996137,8cyclictest28503-21ssh09:54:041
16044996140,12cyclictest0-21swapper/008:27:510
16044996139,13cyclictest0-21swapper/010:28:390
16044996139,12cyclictest0-21swapper/006:09:020
16044996139,12cyclictest0-21swapper/005:13:040
16044996115,39cyclictest0-21swapper/009:46:120
138612613,10sleep30-21swapper/307:57:253
138612613,10sleep30-21swapper/307:57:253
168172603,10sleep10-21swapper/110:24:081
1605399607,29cyclictest13541-21python10:19:103
1605399606,29cyclictest0-21swapper/310:09:093
16053996025,19cyclictest18427-21kernelversion09:39:043
1604499605,48cyclictest0-21swapper/010:18:490
16044996044,11cyclictest0-21swapper/008:54:340
16044996043,11cyclictest0-21swapper/007:59:180
16044996043,11cyclictest0-21swapper/007:48:500
16044996039,12cyclictest0-21swapper/008:49:100
16044996039,11cyclictest0-21swapper/007:23:550
16044996038,13cyclictest0-21swapper/009:38:280
16044996038,12cyclictest0-21swapper/005:33:510
86262593,48sleep00-21swapper/010:13:470
219792593,11sleep30-21swapper/306:23:493
1605399594,48cyclictest0-21swapper/308:16:073
1605299594,50cyclictest0-21swapper/207:27:082
16050995931,13cyclictest0-21swapper/108:48:591
16050995922,21cyclictest0-21swapper/108:29:161
16044995939,11cyclictest0-21swapper/007:48:180
16044995939,11cyclictest0-21swapper/006:29:050
16044995938,11cyclictest0-21swapper/007:39:020
126572593,48sleep10-21swapper/107:54:161
126572593,48sleep10-21swapper/107:54:161
202312583,48sleep120277-21awk10:29:081
16052995834,11cyclictest0-21swapper/210:32:162
1605299583,50cyclictest0-21swapper/208:58:002
1605299583,48cyclictest0-21swapper/208:41:192
16050995827,13cyclictest0-21swapper/107:14:071
16050995827,13cyclictest0-21swapper/107:14:071
1604499586,47cyclictest0-21swapper/007:58:010
1604499586,47cyclictest0-21swapper/007:58:010
1604499585,48cyclictest0-21swapper/006:49:060
16044995837,12cyclictest0-21swapper/010:32:020
48582574,47sleep30-21swapper/308:31:193
1605399575,27cyclictest0-21swapper/309:20:523
1605399575,27cyclictest0-21swapper/309:20:523
1605299575,46cyclictest0-21swapper/208:03:092
1605299574,46cyclictest8945-21ssh10:13:542
16052995736,10cyclictest0-21swapper/209:27:182
16052995733,8cyclictest4301-21ssh09:18:562
16052995733,8cyclictest4301-21ssh09:18:562
1605299573,49cyclictest0-21swapper/209:00:342
1605299573,47cyclictest8782-21diskmemload09:18:242
16050995734,11cyclictest4021-21telnet09:18:541
16050995734,11cyclictest4021-21telnet09:18:541
1605099573,48cyclictest0-21swapper/110:11:121
16044995736,12cyclictest0-21swapper/009:11:070
6902563,12sleep20-21swapper/206:44:192
67222564,45sleep30-21swapper/307:46:003
248599560,5rtkit-daemon2484-21rtkit-daemon09:48:572
198952562,45sleep10-21swapper/105:09:181
1605399564,48cyclictest0-21swapper/308:38:393
16052995632,10cyclictest0-21swapper/208:33:402
16052995630,9cyclictest26728-21crond06:33:472
16050995627,11cyclictest24641-21sed09:48:561
317582553,45sleep131830-21munin-node09:59:011
317582553,45sleep131830-21munin-node09:59:011
16053995539,9cyclictest32257-21sed08:24:043
1605299554,44cyclictest0-21swapper/210:22:522
16052995534,10cyclictest0-21swapper/210:25:312
16052995533,10cyclictest0-21swapper/207:33:272
16052995532,10cyclictest0-21swapper/209:12:142
16052995532,10cyclictest0-21swapper/208:10:532
16050995533,8cyclictest8793-21systemd-cgroups07:03:461
16050995526,13cyclictest0-21swapper/107:13:461
1604499555,27cyclictest0-21swapper/006:58:290
1604499555,27cyclictest0-21swapper/006:34:160
1604499555,27cyclictest0-21swapper/006:34:160
16053995436,10cyclictest16444-21tr07:14:013
16053995436,10cyclictest16444-21tr07:14:013
1605399543,46cyclictest30821-21ssh08:22:493
16052995430,10cyclictest0-21swapper/208:44:022
1605299543,43cyclictest0-21swapper/207:04:042
16050995427,13cyclictest0-21swapper/108:13:571
1604499545,25cyclictest0-21swapper/005:35:330
1604499544,28cyclictest0-21swapper/005:04:020
1604499544,28cyclictest0-21swapper/005:04:020
275402533,44sleep327606-21munin-node05:24:243
1605299534,39cyclictest0-21swapper/205:49:022
1605299534,39cyclictest0-21swapper/205:49:022
16052995338,9cyclictest29195-21ssh08:19:092
16052995334,7cyclictest8782-21diskmemload07:36:142
16052995330,11cyclictest0-21swapper/206:49:222
16052995329,11cyclictest0-21swapper/207:18:482
16052995327,11cyclictest23492-21runrttasks05:19:042
16052995324,14cyclictest0-21swapper/209:03:472
16052995322,13cyclictest0-21swapper/208:24:072
16050995328,10cyclictest21021-21cpuspeed_turbos09:43:541
16050995327,13cyclictest0-21swapper/108:07:131
16050995327,12cyclictest0-21swapper/108:24:151
16050995326,12cyclictest0-21swapper/107:49:031
16050995325,7cyclictest201ktimersoftd/107:19:151
1604499534,27cyclictest0-21swapper/005:28:500
325242523,43sleep30-21swapper/305:36:133
300632524,40sleep20-21swapper/206:39:072
248599520,5rtkit-daemon2484-21rtkit-daemon10:04:113
1605399524,23cyclictest0-21swapper/310:30:393
16052995235,10cyclictest1419-21runrttasks06:12:312
16052995227,9cyclictest25797-21ssh08:14:062
16050995233,7cyclictest32132-21ssh07:35:251
16050995232,8cyclictest28244-21ntp_states06:34:151
16050995232,8cyclictest28244-21ntp_states06:34:151
16050995227,11cyclictest0-21swapper/108:03:391
16050995226,12cyclictest0-21swapper/110:03:521
16050995226,12cyclictest0-21swapper/109:13:431
16050995225,12cyclictest0-21swapper/108:44:131
16050995222,12cyclictest0-21swapper/109:25:411
1604499524,27cyclictest0-21swapper/005:58:120
1604499524,22cyclictest0-21swapper/006:08:490
1604499523,8cyclictest20563-21cut06:19:070
1604499523,31cyclictest21312timerandwakeup05:39:210
16044995229,17cyclictest30028-21grep06:39:060
304132512,43sleep10-21swapper/108:21:211
248599510,5rtkit-daemon2484-21rtkit-daemon10:23:553
248599510,5rtkit-daemon2484-21rtkit-daemon08:43:293
169762512,9sleep30-21swapper/306:11:113
1605399515,40cyclictest0-21swapper/307:28:153
1605399513,24cyclictest0-21swapper/309:17:103
1605299514,29cyclictest0-21swapper/206:18:152
16052995130,10cyclictest0-21swapper/205:32:492
1605299513,42cyclictest0-21swapper/206:59:032
16052995129,6cyclictest0-21swapper/207:39:032
16050995133,7cyclictest23397-21ssh08:10:141
16050995132,8cyclictest22023-21ssh08:57:191
16050995126,10cyclictest18592-21needreboot09:39:061
16050995124,12cyclictest0-21swapper/105:19:031
16050995121,12cyclictest0-21swapper/107:43:421
14652513,9sleep00-21swapper/006:48:450
240552503,41sleep00-21swapper/006:25:070
240162503,41sleep124077-21ps08:59:101
232712502,9sleep30-21swapper/308:09:463
16053995032,10cyclictest3718-21cut05:44:083
16053995032,10cyclictest32612-21gltestperf06:44:083
1605399502,39cyclictest0-21swapper/308:08:143
16052995028,10cyclictest0-21swapper/206:24:192
16052995022,14cyclictest0-21swapper/206:54:072
16052995020,13cyclictest0-21swapper/205:04:102
16052995020,13cyclictest0-21swapper/205:04:102
16050995032,7cyclictest7926-21ssh08:35:131
16050995032,7cyclictest31440-21ssh09:09:491
16050995032,7cyclictest13657-21ssh09:33:371
16050995028,10cyclictest0-21swapper/107:28:181
16050995024,12cyclictest0-21swapper/108:39:201
16050995022,12cyclictest0-21swapper/107:04:031
16050995021,13cyclictest0-21swapper/106:58:461
16050995021,11cyclictest0-21swapper/106:24:051
1604499503,27cyclictest0-21swapper/007:03:460
152102502,9sleep30-21swapper/308:47:113
78422492,10sleep30-21swapper/305:53:583
302952492,9sleep30-21swapper/305:33:193
248599490,4rtkit-daemon2484-21rtkit-daemon10:17:553
180952492,9sleep10-21swapper/105:04:431
180952492,9sleep10-21swapper/105:04:431
172772492,10sleep30-21swapper/308:02:283
16053994931,11cyclictest30547-21needreboot06:39:133
16053994917,9cyclictest0-21swapper/307:29:033
16052994929,9cyclictest0-21swapper/205:24:022
16052994928,10cyclictest0-21swapper/205:44:222
16052994922,10cyclictest20806-21turbostat05:13:512
16052994921,13cyclictest0-21swapper/205:58:492
16052994918,12cyclictest0-21swapper/205:14:092
1605099493,40cyclictest0-21swapper/110:18:461
16050994926,10cyclictest0-21swapper/107:44:061
16050994922,12cyclictest0-21swapper/106:28:591
299312480,6sleep30-21swapper/307:33:503
290582482,40sleep20-21swapper/206:38:112
290582482,40sleep20-21swapper/206:38:112
267242483,7sleep326857-21latency_hist06:33:483
24572482,39sleep30-21swapper/305:39:273
210212483,35sleep10-21swapper/106:19:151
192332482,9sleep10-21swapper/106:14:281
1605399486,13cyclictest0-21swapper/306:24:203
1605399485,34cyclictest0-21swapper/309:45:033
1605399484,34cyclictest0-21swapper/306:58:213
16053994832,11cyclictest19407-21uniq05:09:103
16053994831,10cyclictest6078-21grep05:49:073
16053994831,10cyclictest6078-21grep05:49:073
1605399483,17cyclictest0-21swapper/307:06:143
16053994821,14cyclictest0-21swapper/307:20:323
16052994822,9cyclictest19808-21munin-node06:19:182
16052994821,10cyclictest502-21munin-node05:39:072
1605099484,38cyclictest0-21swapper/109:34:031
16050994830,6cyclictest10560-21ssh10:14:191
1605099483,38cyclictest0-21swapper/106:13:491
1604499484,24cyclictest21870-21grep05:14:100
1604499483,9cyclictest0-21swapper/005:21:120
157362484,38sleep00-21swapper/005:00:160
38142472,39sleep10-21swapper/106:51:361
300142472,39sleep10-21swapper/105:29:381
275752472,38sleep10-21swapper/109:04:141
1605399475,34cyclictest0-21swapper/309:33:413
1605399475,33cyclictest2788-21unixbench-2d07:39:193
1605399475,12cyclictest0-21swapper/309:53:483
1605399475,12cyclictest0-21swapper/305:04:173
1605399475,12cyclictest0-21swapper/305:04:173
1605399474,14cyclictest0-21swapper/309:23:573
1605399474,12cyclictest0-21swapper/306:01:453
1605399474,11cyclictest0-21swapper/306:04:063
16053994728,12cyclictest0-21swapper/306:49:123
16053994726,12cyclictest24273-21gltestperf05:19:123
1605099474,35cyclictest0-21swapper/105:49:011
1605099474,35cyclictest0-21swapper/105:49:011
16050994724,9cyclictest4130-21latency05:44:141
16050994717,13cyclictest0-21swapper/105:24:061
1605399465,14cyclictest0-21swapper/309:58:593
1605399465,14cyclictest0-21swapper/309:58:593
1605399464,13cyclictest0-21swapper/306:34:003
1605399464,13cyclictest0-21swapper/306:34:003
1605399464,12cyclictest0-21swapper/309:33:473
1605399464,12cyclictest0-21swapper/306:59:093
16053994627,12cyclictest21640-21fschecks_count05:14:083
16053994621,15cyclictest0-21swapper/306:14:093
1605399462,23cyclictest0-21swapper/307:09:143
16052994624,8cyclictest10248-21munin-node05:59:032
16050994634,7cyclictest201ktimersoftd/106:44:181
16050994632,9cyclictest1295-21fschecks_time05:39:081
1605099463,35cyclictest0-21swapper/106:04:031
16050994624,11cyclictest0-21swapper/106:39:101
123252462,39sleep10-21swapper/106:02:591
326412452,37sleep10-21swapper/105:37:441
16050994430,9cyclictest0-21swapper/105:54:211
16050994423,10cyclictest0-21swapper/105:18:011
1605299424,25cyclictest0-21swapper/206:08:182
248599380,4rtkit-daemon2484-21rtkit-daemon04:59:451
1605399384,15cyclictest0-21swapper/305:03:523
16052993824,10cyclictest0-21swapper/205:03:512
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional