You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-25 - 01:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Sat Apr 25, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3250899984,12cyclictest19664-21awk22:05:301
32508999812,9cyclictest11145-21df_abs19:30:251
3250899964,66cyclictest22090-21cpu17:50:261
3250899964,13cyclictest0-21swapper/121:12:051
3250899963,20cyclictest24627-21df_abs19:50:241
3250899954,65cyclictest0-21swapper/120:05:241
3250899945,66cyclictest0-21swapper/122:15:031
3250899945,13cyclictest0-21swapper/120:22:321
3250899944,66cyclictest0-21swapper/119:05:231
32508999411,65cyclictest0-21swapper/119:45:241
3250499944,83cyclictest17700-21tune2fs21:15:240
3250499944,82cyclictest0-21swapper/019:30:300
3250899935,13cyclictest0-21swapper/122:30:571
3250899934,13cyclictest0-21swapper/119:13:251
3250899934,12cyclictest0-21swapper/121:35:211
3250899925,13cyclictest0-21swapper/120:25:421
3250899925,13cyclictest0-21swapper/119:24:271
71542910,3sleep1201ktimersoftd/121:00:201
71542910,3sleep1201ktimersoftd/121:00:201
3250899916,13cyclictest0-21swapper/121:21:031
3250899915,12cyclictest1630-21sed19:15:401
3250899914,67cyclictest0-21swapper/121:15:171
3250899914,13cyclictest0-21swapper/121:09:501
3250899914,12cyclictest19479-21entropy20:30:251
3250499914,80cyclictest0-21swapper/019:25:350
3250499913,81cyclictest0-21swapper/019:39:480
3250899904,14cyclictest0-21swapper/122:25:441
32508999018,56cyclictest2392-21chrt20:52:261
3250899895,13cyclictest0-21swapper/121:42:381
3250899895,13cyclictest0-21swapper/121:42:381
3250899894,66cyclictest0-21swapper/121:26:041
3250899894,13cyclictest0-21swapper/121:45:181
32508998919,49cyclictest0-21swapper/120:01:551
3250899884,63cyclictest22831-21ssh20:35:231
3250899884,13cyclictest0-21swapper/120:46:501
3250499883,78cyclictest0-21swapper/021:24:410
3250499883,78cyclictest0-21swapper/019:19:060
3250499883,76cyclictest15246-21crond20:25:080
32508998728,53cyclictest10738-21fschecks_time17:25:321
3250499874,76cyclictest0-21swapper/021:58:170
3250499872,78cyclictest0-21swapper/020:54:410
89612860,5chrt37-21ksoftirqd/321:50:243
3250899864,16cyclictest0-21swapper/121:50:351
3250899864,13cyclictest0-21swapper/119:59:331
3250899864,12cyclictest25160-21aten_r1power_fr22:15:151
32508998623,54cyclictest16201-21missed_timers22:00:281
32508998620,48cyclictest0-21swapper/119:26:461
3250499864,76cyclictest0-21swapper/022:05:310
3250499864,75cyclictest0-21swapper/019:12:310
3250499863,77cyclictest0-21swapper/021:02:350
3250499863,77cyclictest0-21swapper/021:02:350
3250499863,76cyclictest29193-21grep22:20:220
3250499863,76cyclictest29193-21grep22:20:220
3250499863,76cyclictest0-21swapper/019:06:000
3250899856,14cyclictest0-21swapper/120:40:261
3250899854,61cyclictest0-21swapper/118:40:491
3250899854,12cyclictest13460-21munin-node21:55:371
3250499854,74cyclictest0-21swapper/020:40:240
3250499854,73cyclictest0-21swapper/022:29:470
3250499853,75cyclictest20030-21unixbench_multi18:50:440
3250899844,60cyclictest0-21swapper/120:13:511
3250899844,57cyclictest0-21swapper/121:30:171
3250899844,13cyclictest0-21swapper/120:15:351
3250499849,68cyclictest0-21swapper/019:05:110
3250499844,74cyclictest0-21swapper/020:35:060
3250499844,71cyclictest0-21swapper/022:34:550
3250499844,57cyclictest4596-21ssh21:45:040
3250499844,57cyclictest4596-21ssh21:45:040
3250499843,74cyclictest0-21swapper/020:35:120
3250499843,73cyclictest0-21swapper/020:46:360
3250899834,62cyclictest0-21swapper/117:15:351
3250899834,55cyclictest0-21swapper/122:20:191
3250899834,55cyclictest0-21swapper/122:20:191
3250899834,12cyclictest0-21swapper/117:10:161
32508998328,48cyclictest29960-21tail18:05:321
3250499834,71cyclictest0-21swapper/021:32:450
3250499833,72cyclictest11443-21needreboot21:05:300
3250499833,34cyclictest0-21swapper/020:05:420
3250899825,11cyclictest4406-21hwlatdetect20:55:271
3250899824,13cyclictest0-21swapper/119:00:271
3250899824,13cyclictest0-21swapper/118:50:471
3250899824,13cyclictest0-21swapper/118:35:131
3250899823,55cyclictest0-21swapper/119:36:421
32508998223,52cyclictest12336-21needreboot18:35:361
32508998222,53cyclictest17254-21proc_pri18:45:391
32508998215,42cyclictest0-21swapper/117:20:271
3250499824,72cyclictest0-21swapper/018:45:270
3250499824,71cyclictest0-21swapper/022:12:030
3250499824,71cyclictest0-21swapper/019:55:250
3250499823,73cyclictest0-21swapper/020:56:530
3250499823,72cyclictest3149-21kworker/0:021:35:180
3250499823,72cyclictest24335-21sh19:50:210
3250899814,60cyclictest0-21swapper/119:40:191
3250899814,60cyclictest0-21swapper/119:40:191
3250899814,12cyclictest894-21taskset18:11:321
3250899814,12cyclictest894-21taskset18:11:321
3250499814,71cyclictest0-21swapper/019:41:020
3250499814,71cyclictest0-21swapper/019:41:020
3250499814,71cyclictest0-21swapper/017:40:450
3250499814,69cyclictest0-21swapper/020:00:390
3250899804,13cyclictest0-21swapper/117:35:321
3250899804,10cyclictest193892sleep117:45:151
3250499805,56cyclictest9545-21netstat21:50:320
3250499804,69cyclictest0-21swapper/021:25:200
3250499804,69cyclictest0-21swapper/020:15:400
3250499803,70cyclictest26793-21timerwakeupswit22:15:370
3250499803,69cyclictest6163-21ntp_kernel_pll_21:45:310
248599800,4rtkit-daemon2484-21rtkit-daemon19:18:142
3250899795,58cyclictest0-21swapper/118:00:241
32508997915,57cyclictest21308-21unixbench_singl17:45:471
32504997932,41cyclictest6280-21grep20:10:280
3250499793,70cyclictest0-21swapper/020:26:590
3250499793,59cyclictest0-21swapper/022:00:170
3250899788,9cyclictest6520-21aten2.4-expect18:25:251
3250499783,68cyclictest0-21swapper/021:13:340
3250499783,68cyclictest0-21swapper/019:22:550
3250499783,67cyclictest0-21swapper/018:30:230
3250899774,12cyclictest0-21swapper/118:56:311
3250899774,12cyclictest0-21swapper/118:56:311
3250499773,67cyclictest22717-21ssh19:45:500
3250899768,13cyclictest0-21swapper/117:55:441
3250899765,12cyclictest0-21swapper/118:17:351
3250499768,61cyclictest7361-21crond17:20:140
3250499763,64cyclictest0-21swapper/018:35:420
3250899758,8cyclictest0-21swapper/117:10:261
3250899754,14cyclictest0-21swapper/118:23:531
32504997516,40cyclictest121850irq/46-eth017:50:320
32510997412,55cyclictest0-21swapper/319:50:233
3250899745,14cyclictest0-21swapper/117:05:161
3250899744,13cyclictest14318-21runrttasks17:32:381
3250899744,13cyclictest14318-21runrttasks17:32:381
32510997324,42cyclictest21154-21cpuspeed_turbos19:45:233
3250499734,62cyclictest0-21swapper/018:30:140
3250499733,54cyclictest0-21swapper/017:25:250
32510997222,30cyclictest29990-21iostat_ios19:10:333
3250499723,62cyclictest379-21telnet17:05:270
32504997224,41cyclictest2791-21tail18:15:360
3250499722,65cyclictest0-21swapper/017:35:380
32510997126,17cyclictest29283-21unixbench-2d19:55:423
32510997125,30cyclictest32143-21sed21:35:393
3250499714,60cyclictest0-21swapper/018:10:340
3250499714,60cyclictest0-21swapper/018:10:340
3250499713,61cyclictest1287-21snmpd18:55:290
3250499713,61cyclictest1287-21snmpd18:55:290
3250499713,61cyclictest0-21swapper/018:40:290
32504997120,44cyclictest26709-21munin-node18:00:300
32504997118,47cyclictest24598-21cpuspeed_turbos17:55:270
32510997016,46cyclictest0-21swapper/319:44:553
32510997016,46cyclictest0-21swapper/319:44:553
32510997013,51cyclictest0-21swapper/321:17:483
32510997012,39cyclictest0-21swapper/322:25:293
3250499705,59cyclictest0-21swapper/017:45:430
3250499705,49cyclictest0-21swapper/017:10:270
3250499703,61cyclictest0-21swapper/017:22:210
32510996924,37cyclictest8353-21wc19:25:353
32510996918,31cyclictest0-21swapper/320:12:203
32510996912,50cyclictest0-21swapper/317:55:443
3250499693,44cyclictest0-21swapper/018:20:250
248599690,4rtkit-daemon2484-21rtkit-daemon20:53:103
32510996816,34cyclictest0-21swapper/320:17:043
3251099675,45cyclictest0-21swapper/319:20:273
32510996726,24cyclictest0-21swapper/320:21:103
32510996721,39cyclictest1419-21runrttasks19:05:103
32510996719,31cyclictest0-21swapper/320:35:193
32510996714,45cyclictest13171-21switchtime21:55:353
32510996613,31cyclictest0-21swapper/322:33:113
3250499664,57cyclictest0-21swapper/017:33:250
3250499664,57cyclictest0-21swapper/017:33:250
32504996616,43cyclictest29192-21tail18:05:250
3251099658,50cyclictest0-21swapper/317:50:353
32510996520,28cyclictest15401-21rm19:35:373
32510996519,27cyclictest25759-21sort22:15:213
32510996517,29cyclictest0-21swapper/321:40:213
32510996517,29cyclictest0-21swapper/321:40:213
32510996512,46cyclictest0-21swapper/320:00:323
3250999655,41cyclictest1419-21runrttasks18:10:132
3250499655,53cyclictest32495-21cyclictest17:05:160
32510996421,34cyclictest27079-21processes20:40:383
32510996421,17cyclictest17172-21timerandwakeup20:25:403
32510996414,29cyclictest0-21swapper/321:06:593
32510996410,33cyclictest0-21swapper/321:49:483
248599640,4rtkit-daemon2484-21rtkit-daemon20:11:572
248599640,4rtkit-daemon2484-21rtkit-daemon19:33:433
248599640,4rtkit-daemon2484-21rtkit-daemon17:27:032
99982638,9sleep210103-21users21:50:402
32510996321,27cyclictest25145-21munin-node21:25:343
32510996320,19cyclictest22835-21ssh22:10:283
32510996317,27cyclictest0-21swapper/320:45:323
32510996313,41cyclictest0-21swapper/319:05:333
3251099628,31cyclictest0-21swapper/321:03:003
3251099628,31cyclictest0-21swapper/321:03:003
32510996224,30cyclictest3446-21munin-node20:55:343
32510996224,16cyclictest20720-21unixbench_singl20:30:413
32510996222,33cyclictest3086-21sshd20:05:303
3251099622,54cyclictest0-21swapper/322:04:403
32510996214,41cyclictest0-21swapper/322:20:213
32510996214,41cyclictest0-21swapper/322:20:213
248599620,5rtkit-daemon2484-21rtkit-daemon19:59:122
32510996119,28cyclictest0-21swapper/321:31:373
32510996117,37cyclictest18933-21sed22:05:193
32510996111,42cyclictest19004-21fschecks_time18:50:303
32510996013,40cyclictest0-21swapper/319:20:103
32510996013,33cyclictest0-21swapper/321:13:593
32510996013,31cyclictest0-21swapper/318:30:253
250862603,50sleep225137-21basename22:15:152
214292603,50sleep221578-21grep19:45:282
32510995916,35cyclictest1287-21snmpd18:06:433
3251099589,41cyclictest0-21swapper/317:40:343
3251099589,32cyclictest0-21swapper/321:20:183
32510995827,24cyclictest1804-21cpuspeed_turbos18:15:253
32510995816,25cyclictest7238-21taskset17:18:413
32510995812,38cyclictest0-21swapper/317:10:303
3250999584,45cyclictest0-21swapper/220:55:212
3250999583,47cyclictest0-21swapper/220:05:392
32509995822,12cyclictest31312-21gltestperf21:35:252
32510995715,36cyclictest1287-21snmpd18:00:253
32510995711,39cyclictest0-21swapper/318:20:493
32510995710,26cyclictest19537-21munin-node17:45:463
3250999575,44cyclictest0-21swapper/221:15:192
3250999574,34cyclictest0-21swapper/221:29:492
3250999574,13cyclictest0-21swapper/222:00:262
32509995720,14cyclictest0-21swapper/220:50:212
32510995626,23cyclictest1419-21runrttasks18:49:223
32510995621,28cyclictest0-21swapper/318:41:573
32510995617,21cyclictest22631sshd17:06:383
3250999564,45cyclictest0-21swapper/219:30:352
3250999564,38cyclictest0-21swapper/219:23:472
3250999564,36cyclictest0-21swapper/222:12:452
3251099559,40cyclictest0-21swapper/317:20:273
32510995512,36cyclictest10705-21perl17:25:323
32509995521,22cyclictest0-21swapper/220:18:192
32509995512,24cyclictest0-21swapper/220:00:352
58022542,10sleep20-21swapper/218:21:042
32510995424,16cyclictest15500-21fschecks_time17:35:323
32510995412,35cyclictest13347-21if_eth017:30:343
32510995412,35cyclictest13347-21if_eth017:30:343
32510995411,35cyclictest31545-21telnet18:10:263
32510995411,35cyclictest31545-21telnet18:10:263
3250999544,34cyclictest0-21swapper/220:25:342
3250999544,31cyclictest0-21swapper/222:30:182
32509995415,24cyclictest0-21swapper/219:38:252
75322533,43sleep20-21swapper/221:48:302
32510995316,20cyclictest6363-21munin-node18:25:463
3250999535,30cyclictest0-21swapper/220:40:332
3250999534,28cyclictest0-21swapper/222:05:252
3250999534,11cyclictest24142-21yum-updatesd-he19:50:202
32509995337,9cyclictest29783-21grep19:10:302
32509995335,11cyclictest9356-21unixbench_singl17:20:482
3251099529,36cyclictest11717-21entropy18:35:283
3250999524,42cyclictest0-21swapper/221:43:362
3250999524,42cyclictest0-21swapper/221:43:362
3250999524,41cyclictest0-21swapper/222:25:312
3250999524,40cyclictest0-21swapper/221:05:242
3250999524,31cyclictest0-21swapper/220:20:432
3250999524,28cyclictest0-21swapper/220:30:432
3250999524,24cyclictest0-21swapper/221:20:172
32509995221,12cyclictest0-21swapper/219:00:322
3250999515,27cyclictest0-21swapper/220:45:212
3250999514,28cyclictest0-21swapper/221:30:202
3250999514,26cyclictest0-21swapper/222:20:482
3250999514,26cyclictest0-21swapper/222:20:482
77692505,10sleep21676-21nscd19:25:292
32510995022,14cyclictest21818-21missed_timers18:55:353
32510995022,14cyclictest21818-21missed_timers18:55:353
3250999504,30cyclictest0-21swapper/219:40:252
3250999504,30cyclictest0-21swapper/219:40:252
3250999504,28cyclictest0-21swapper/218:15:132
3250999504,28cyclictest0-21swapper/218:15:132
3250999504,28cyclictest0-21swapper/217:45:412
3250999504,28cyclictest0-21swapper/217:05:262
3250999504,23cyclictest21911-21yum-updatesd-he17:50:252
3250999504,13cyclictest0-21swapper/221:10:402
3250999503,29cyclictest0-21swapper/221:55:322
3250999503,25cyclictest0-21swapper/220:35:412
32509995020,13cyclictest0-21swapper/218:30:262
32509995020,12cyclictest0-21swapper/218:55:362
32509995020,12cyclictest0-21swapper/218:55:362
248599500,5rtkit-daemon2484-21rtkit-daemon17:00:343
3250999494,39cyclictest0-21swapper/221:00:302
3250999494,39cyclictest0-21swapper/221:00:302
3250999494,28cyclictest0-21swapper/218:40:342
3250999494,28cyclictest0-21swapper/218:15:322
3250999494,27cyclictest0-21swapper/217:15:302
32509994932,11cyclictest6671-21grep18:25:272
3250999484,27cyclictest0-21swapper/218:50:402
3250999484,27cyclictest0-21swapper/217:10:312
3250999484,26cyclictest0-21swapper/218:00:332
32509994834,8cyclictest17992-21gltestperf17:40:342
3250999483,25cyclictest27194-21grep19:05:432
32509994827,14cyclictest16511-21grep17:35:472
3250999474,26cyclictest0-21swapper/218:46:492
32509994717,13cyclictest0-21swapper/217:35:142
32509994717,13cyclictest0-21swapper/217:35:142
3250999464,33cyclictest0-21swapper/217:05:172
3250999454,25cyclictest0-21swapper/218:35:222
253322452,37sleep20-21swapper/217:55:372
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional