You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-22 - 22:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Fri May 22, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
14607991225,67cyclictest14591-21cut09:59:310
14607991225,67cyclictest14591-21cut09:59:310
248599780,6rtkit-daemon0-21swapper/204:39:481
248599760,7rtkit-daemon22617-21ssh07:49:100
14616997514,30cyclictest3878-21cpu09:44:263
14616997427,40cyclictest7670-21grep07:24:513
14616997424,29cyclictest11816-21fschecks_count06:44:383
14616997418,34cyclictest0-21swapper/308:39:483
14616997418,34cyclictest0-21swapper/308:39:483
1461699735,51cyclictest0-21swapper/304:43:333
14616997227,38cyclictest4495-21tr08:09:313
14616997126,36cyclictest16280-21ssh07:39:303
14616997125,27cyclictest27006-21fschecks_time07:54:343
14616997117,47cyclictest15269-21seq09:13:413
1461499714,61cyclictest0-21swapper/208:51:322
14616997021,31cyclictest7170-21grep08:59:473
14616996922,19cyclictest29857-21uniq09:34:313
14616996824,36cyclictest4545-21unixbench_singl06:29:543
14616996822,30cyclictest0-21swapper/309:32:013
14616996821,31cyclictest20745-21ssh08:34:163
14616996821,30cyclictest25610-21perl07:04:393
14616996817,31cyclictest0-21swapper/306:28:503
14616996813,37cyclictest0-21swapper/305:29:403
14616996728,32cyclictest27945-21aten_r1power_cu06:14:333
14616996724,36cyclictest32467-21hwlatdetect05:14:443
14616996724,36cyclictest32467-21hwlatdetect05:14:443
14616996724,35cyclictest7888-21ls08:14:313
14616996723,37cyclictest9121-21runrttasks09:50:333
14616996720,18cyclictest121850irq/46-eth008:34:323
14616996719,32cyclictest0-21swapper/307:22:453
14616996719,32cyclictest0-21swapper/307:22:453
14616996718,41cyclictest29147-21proc_pri08:44:433
14614996725,25cyclictest19318-21nfs_client06:54:462
14616996620,30cyclictest1287-21snmpd07:31:093
14616996617,41cyclictest1287-21snmpd04:53:353
1461499664,36cyclictest0-21swapper/206:39:532
1461499664,36cyclictest0-21swapper/206:39:532
1461699655,52cyclictest0-21swapper/307:46:243
14616996527,31cyclictest18071-21tail04:44:453
14616996526,18cyclictest30381-21fschecks_time07:59:363
14616996526,18cyclictest30381-21fschecks_time07:59:363
14616996523,33cyclictest18254-21grep10:04:373
14616996521,37cyclictest0-21swapper/308:20:183
14616996520,38cyclictest0-21swapper/309:20:483
14616996520,38cyclictest0-21swapper/309:20:483
14616996520,29cyclictest2523-21unixbench_multi08:04:513
14616996519,29cyclictest16306-21yum-updatesd-he08:25:413
14616996517,41cyclictest0-21swapper/307:14:213
14616996517,41cyclictest0-21swapper/307:14:213
14616996517,30cyclictest0-21swapper/309:17:523
1461499654,55cyclictest0-21swapper/207:26:082
1461499653,46cyclictest0-21swapper/208:19:272
14616996422,15cyclictest1287-21snmpd06:50:453
14616996420,37cyclictest0-21swapper/308:54:163
14616996419,38cyclictest26640-21latency06:09:463
14616996418,39cyclictest0-21swapper/306:40:133
14616996418,39cyclictest0-21swapper/306:40:133
14616996416,32cyclictest0-21swapper/309:54:243
14616996414,42cyclictest0-21swapper/307:52:473
14616996414,42cyclictest0-21swapper/307:35:443
14614996419,24cyclictest26-21rcuc/208:59:432
14612996427,32cyclictest0-21swapper/109:24:431
170132633,52sleep00-21swapper/005:49:460
14616996322,26cyclictest1491-21ntp_states09:39:423
14616996322,25cyclictest9343-21cstates09:04:293
14616996320,37cyclictest19933-21sh06:55:033
14616996319,28cyclictest30586-21ssh07:11:443
14616996315,32cyclictest0-21swapper/308:54:253
14616996312,45cyclictest0-21swapper/309:26:563
14616996310,30cyclictest0-21swapper/310:02:183
14616996310,30cyclictest0-21swapper/310:02:183
1461499634,12cyclictest0-21swapper/209:47:592
14607996345,13cyclictest0-21swapper/009:13:220
14616996217,26cyclictest12994-21users05:39:583
1461499627,34cyclictest0-21swapper/206:47:392
1461499623,11cyclictest0-21swapper/208:58:492
14607996243,12cyclictest0-21swapper/008:54:340
1461699619,34cyclictest0-21swapper/305:25:453
14616996122,32cyclictest1419-21runrttasks05:01:073
14616996122,31cyclictest21604-21ssh06:59:323
1461499614,12cyclictest0-21swapper/209:10:172
1461499613,38cyclictest0-21swapper/209:25:332
1460799615,48cyclictest0-21swapper/009:18:200
203902603,49sleep10-21swapper/106:56:331
194232603,9sleep00-21swapper/010:06:140
14616996020,33cyclictest1419-21runrttasks04:58:133
14616996015,38cyclictest25304-21munin-run06:09:223
1461499604,12cyclictest0-21swapper/208:30:392
14614996016,31cyclictest0-21swapper/208:37:142
1460799604,50cyclictest0-21swapper/008:04:380
1460799604,49cyclictest0-21swapper/007:25:010
191252593,48sleep00-21swapper/005:54:420
191252593,48sleep00-21swapper/005:54:420
14616995919,25cyclictest22910-21crond06:04:223
14616995916,36cyclictest3632-21seq05:22:203
14607995944,9cyclictest21929-21grep08:34:360
14607995941,13cyclictest0-21swapper/007:14:230
14607995941,13cyclictest0-21swapper/007:14:230
14607995941,12cyclictest0-21swapper/007:54:270
1460799593,12cyclictest0-21swapper/008:44:260
14616995819,32cyclictest19813-21chrt05:54:523
14616995819,32cyclictest19813-21chrt05:54:523
14616995819,32cyclictest1419-21runrttasks06:22:453
14612995843,9cyclictest14590-21grep09:59:311
14612995843,9cyclictest14590-21grep09:59:311
1460799585,47cyclictest1419-21runrttasks06:47:090
1460799585,47cyclictest0-21swapper/008:02:330
1460799585,47cyclictest0-21swapper/008:02:330
14607995841,12cyclictest0-21swapper/007:01:340
14607995841,12cyclictest0-21swapper/006:50:110
14607995840,14cyclictest0-21swapper/006:42:400
14607995840,14cyclictest0-21swapper/006:42:400
1460799584,47cyclictest0-21swapper/006:14:440
1460799584,46cyclictest0-21swapper/008:59:300
163082574,12sleep10-21swapper/108:25:301
1461499574,9cyclictest29096-21ntp_states08:44:422
1461499574,12cyclictest0-21swapper/207:59:442
1461499574,12cyclictest0-21swapper/207:59:442
1461499574,12cyclictest0-21swapper/207:18:232
1461499574,12cyclictest0-21swapper/207:18:232
1461499574,11cyclictest0-21swapper/208:09:372
14614995737,12cyclictest16951-21grep09:14:392
14607995742,11cyclictest0-21swapper/007:42:430
14607995741,11cyclictest0-21swapper/009:54:170
14607995740,12cyclictest0-21swapper/006:59:060
14607995739,12cyclictest0-21swapper/009:25:400
14607995738,13cyclictest0-21swapper/008:24:330
248599560,5rtkit-daemon2484-21rtkit-daemon09:04:151
14616995621,27cyclictest7187-21seq06:37:213
14616995621,27cyclictest7187-21seq06:37:213
14616995615,35cyclictest9033-21cpu05:34:383
1461499564,25cyclictest0-21swapper/205:49:352
1461499564,13cyclictest0-21swapper/209:49:262
1461499564,12cyclictest0-21swapper/209:59:442
1461499564,12cyclictest0-21swapper/209:59:442
14607995640,12cyclictest0-21swapper/008:18:280
14607995640,12cyclictest0-21swapper/008:11:490
1460799564,47cyclictest0-21swapper/009:04:360
14607995639,13cyclictest0-21swapper/007:30:300
14607995639,12cyclictest0-21swapper/008:29:390
14607995639,12cyclictest0-21swapper/007:09:000
14607995637,14cyclictest0-21swapper/009:29:390
14607995629,8cyclictest10130-21latency_hist09:54:140
28942553,46sleep12900-21ssh08:05:501
252932554,44sleep20-21swapper/206:09:222
248599550,6rtkit-daemon2484-21rtkit-daemon09:14:141
248599550,6rtkit-daemon2484-21rtkit-daemon08:34:161
248599550,5rtkit-daemon2484-21rtkit-daemon09:09:151
248599550,5rtkit-daemon2484-21rtkit-daemon08:24:161
228892553,44sleep00-21swapper/007:49:210
216462554,42sleep20-21swapper/207:45:402
1461499555,27cyclictest13108-21grep07:34:322
1461499554,37cyclictest0-21swapper/209:19:442
1461499554,37cyclictest0-21swapper/209:19:442
1461499554,12cyclictest0-21swapper/207:23:402
1461499554,12cyclictest0-21swapper/207:23:402
1461499554,11cyclictest0-21swapper/209:37:482
1461499554,11cyclictest0-21swapper/206:19:212
1461499553,11cyclictest0-21swapper/207:03:342
14614995517,24cyclictest0-21swapper/209:40:062
14612995530,12cyclictest0-21swapper/108:53:251
14612995530,12cyclictest0-21swapper/107:22:511
14612995530,12cyclictest0-21swapper/107:22:511
14607995537,14cyclictest0-21swapper/007:20:430
14607995537,14cyclictest0-21swapper/007:20:430
14607995537,12cyclictest0-21swapper/007:10:110
14607995534,14cyclictest0-21swapper/004:59:250
14607995524,25cyclictest0-21swapper/008:44:160
14607995524,25cyclictest0-21swapper/008:44:160
105462553,45sleep110644-21cpuspeed09:54:261
321312543,7sleep132135-21ssh09:38:421
303662544,12sleep20-21swapper/205:09:502
268702544,44sleep20-21swapper/209:29:402
248599540,5rtkit-daemon2484-21rtkit-daemon09:29:291
248599540,5rtkit-daemon2484-21rtkit-daemon08:56:381
248599540,5rtkit-daemon2484-21rtkit-daemon05:44:231
248599540,4rtkit-daemon2484-21rtkit-daemon05:29:381
154672543,44sleep00-21swapper/005:45:430
14616995416,31cyclictest16345-21cpuspeed_turbos05:49:373
1461499545,29cyclictest0-21swapper/209:54:482
1461499544,33cyclictest0-21swapper/206:49:402
1461499544,30cyclictest0-21swapper/207:39:442
1461499544,30cyclictest0-21swapper/205:39:302
1461499544,29cyclictest0-21swapper/205:24:512
1461499543,37cyclictest0-21swapper/208:17:592
14614995422,14cyclictest0-21swapper/208:29:072
14612995435,13cyclictest0-21swapper/107:09:501
1460799544,45cyclictest0-21swapper/008:52:300
14607995419,29cyclictest24050-21http_loadtime06:04:430
96382532,44sleep10-21swapper/108:15:501
248599530,5rtkit-daemon2484-21rtkit-daemon09:49:131
248599530,5rtkit-daemon2484-21rtkit-daemon08:39:461
248599530,5rtkit-daemon2484-21rtkit-daemon08:39:461
248599530,5rtkit-daemon2484-21rtkit-daemon05:04:391
14616995320,26cyclictest0-21swapper/305:04:453
14616995316,31cyclictest1287-21snmpd05:48:443
14616995313,34cyclictest30042-21smartctl05:09:433
1461499534,30cyclictest0-21swapper/204:39:592
1461499534,29cyclictest0-21swapper/206:33:512
1461499534,28cyclictest0-21swapper/207:54:182
14614995321,13cyclictest0-21swapper/207:30:112
14614995320,15cyclictest0-21swapper/204:59:512
14612995317,30cyclictest16737-21interrupts09:14:351
14607995339,9cyclictest27609-21runrttasks05:04:460
14607995338,10cyclictest0-21swapper/009:43:030
14607995333,15cyclictest0-21swapper/005:24:340
130342533,42sleep00-21swapper/005:40:150
248599520,5rtkit-daemon2484-21rtkit-daemon08:34:311
248599520,5rtkit-daemon2484-21rtkit-daemon06:01:521
248599520,4rtkit-daemon2484-21rtkit-daemon05:39:231
189932522,42sleep10-21swapper/107:43:171
15442523,43sleep00-21swapper/006:24:480
1461499526,39cyclictest0-21swapper/205:04:502
1461499524,29cyclictest0-21swapper/208:04:322
1461499524,29cyclictest0-21swapper/205:54:442
1461499524,29cyclictest0-21swapper/205:54:442
1461499524,28cyclictest0-21swapper/209:04:352
1461499524,28cyclictest0-21swapper/207:57:002
1461499524,28cyclictest0-21swapper/207:10:312
1461499524,28cyclictest0-21swapper/205:29:302
1461499524,28cyclictest0-21swapper/205:19:462
14614995236,10cyclictest1094-21grep06:24:402
14614995235,10cyclictest22485-21grep05:59:552
1461499523,29cyclictest0-21swapper/205:44:482
14614995221,13cyclictest0-21swapper/208:44:162
14614995221,13cyclictest0-21swapper/208:44:162
14614995211,24cyclictest0-21swapper/207:04:342
14612995220,27cyclictest1419-21runrttasks07:51:421
14607995236,11cyclictest0-21swapper/005:59:530
14607995235,13cyclictest0-21swapper/007:37:140
14607995234,14cyclictest0-21swapper/008:20:340
14607995233,13cyclictest0-21swapper/004:44:370
14607995232,14cyclictest0-21swapper/009:37:500
14607995231,17cyclictest0-21swapper/009:19:550
14607995231,17cyclictest0-21swapper/009:19:550
1460799523,43cyclictest1419-21runrttasks06:19:570
248599510,5rtkit-daemon2484-21rtkit-daemon05:24:531
1461499514,27cyclictest0-21swapper/210:08:042
14614995135,9cyclictest26181-21grep06:09:402
1461499513,28cyclictest0-21swapper/205:14:562
1461499513,28cyclictest0-21swapper/205:14:562
14614995120,14cyclictest0-21swapper/206:34:372
14614995120,14cyclictest0-21swapper/206:34:372
14614995119,13cyclictest0-21swapper/206:19:502
14612995137,10cyclictest0-21swapper/108:11:011
1460799515,41cyclictest0-21swapper/009:44:470
14607995133,13cyclictest0-21swapper/004:39:380
324492502,9sleep10-21swapper/106:24:171
248599500,4rtkit-daemon2484-21rtkit-daemon09:39:431
248599500,4rtkit-daemon2484-21rtkit-daemon04:57:391
1461499504,28cyclictest0-21swapper/204:54:502
14614995019,13cyclictest0-21swapper/204:44:482
14614995017,14cyclictest0-21swapper/204:49:352
1461299505,39cyclictest0-21swapper/106:49:411
1461299504,40cyclictest0-21swapper/107:25:411
14612995036,9cyclictest13692-21gltestperf07:34:371
14612995016,28cyclictest25672-21aten_r1power_vo06:09:351
1460799504,40cyclictest0-21swapper/004:49:350
14607995033,12cyclictest0-21swapper/005:19:380
14607995032,13cyclictest0-21swapper/006:29:320
14607995025,10cyclictest0-21swapper/004:59:580
71442492,9sleep10-21swapper/106:36:461
71442492,9sleep10-21swapper/106:36:461
282542492,40sleep10-21swapper/107:55:101
248599490,5rtkit-daemon2484-21rtkit-daemon05:04:241
217832492,40sleep10-21swapper/109:22:541
217832492,40sleep10-21swapper/109:22:541
17762492,40sleep10-21swapper/106:24:531
1461499494,13cyclictest0-21swapper/205:34:442
14612994933,10cyclictest0-21swapper/109:49:441
14612994925,11cyclictest0-21swapper/110:06:481
14612994921,23cyclictest0-21swapper/107:00:341
14607994921,11cyclictest0-21swapper/006:09:520
249652482,41sleep10-21swapper/106:05:061
248599480,5rtkit-daemon2484-21rtkit-daemon04:44:401
14612994832,11cyclictest14260-21crond06:49:201
1461299483,12cyclictest0-21swapper/107:05:571
14612994829,13cyclictest0-21swapper/107:29:431
1460799485,26cyclictest0-21swapper/006:34:470
1460799485,26cyclictest0-21swapper/006:34:470
84742473,38sleep00-21swapper/005:33:010
35522472,38sleep10-21swapper/105:21:171
310682473,36sleep00-21swapper/005:11:250
248599470,5rtkit-daemon2484-21rtkit-daemon08:48:301
216292473,9sleep10-21swapper/104:52:481
14616994720,22cyclictest0-21swapper/304:39:263
14612994731,10cyclictest16348-21tr05:49:371
104512472,38sleep10-21swapper/106:43:071
104512472,38sleep10-21swapper/106:43:071
47282462,9sleep10-21swapper/106:31:221
220152462,38sleep10-21swapper/107:47:001
14612994631,10cyclictest0-21swapper/107:59:311
14612994631,10cyclictest0-21swapper/107:59:311
14612994628,12cyclictest0-21swapper/105:54:381
14612994628,12cyclictest0-21swapper/105:54:381
142842464,6sleep00-21swapper/004:35:350
17682452,9sleep10-21swapper/107:17:331
17682452,9sleep10-21swapper/107:17:331
14612994531,10cyclictest28194-21cpuspeed_turbos06:14:351
1460799454,25cyclictest0-21swapper/005:14:390
1460799454,25cyclictest0-21swapper/005:14:390
1460799453,37cyclictest0-21swapper/005:34:400
14612994419,12cyclictest0-21swapper/105:44:291
143972444,34sleep10-21swapper/104:37:051
248599430,4rtkit-daemon2484-21rtkit-daemon04:34:402
1461299434,34cyclictest0-21swapper/105:14:361
1461299434,34cyclictest0-21swapper/105:14:361
312292422,34sleep10-21swapper/105:13:311
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional