You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-10 - 08:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Fri Apr 10, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2485991070,8rtkit-daemon0-21swapper/117:34:481
2584621040,9sleep20-21swapper/220:14:262
36892980,4sleep13691-21grep22:04:271
36892980,4sleep13691-21grep22:04:271
248599970,7rtkit-daemon0-21swapper/117:54:321
248599970,7rtkit-daemon0-21swapper/117:49:481
248599970,6rtkit-daemon0-21swapper/118:04:241
248599970,6rtkit-daemon0-21swapper/118:04:241
248599970,5rtkit-daemon9255-21taskset17:45:101
2756599964,27cyclictest0-21swapper/022:30:570
248599960,7rtkit-daemon0-21swapper/117:27:561
248599960,7rtkit-daemon0-21swapper/117:27:561
248599960,6rtkit-daemon5157-21aten_r1power_po17:39:331
248599960,5rtkit-daemon20498-21memory18:09:471
2756599958,22cyclictest0-21swapper/020:44:140
248599940,6rtkit-daemon29756-21sshd17:22:041
2756599924,79cyclictest0-21swapper/021:29:250
2756599924,79cyclictest0-21swapper/021:29:250
2756599914,77cyclictest0-21swapper/020:31:480
2756599913,29cyclictest6069-21taskset22:08:550
2756599913,29cyclictest6069-21taskset22:08:550
27565999123,60cyclictest0-21swapper/021:19:440
27565999117,12cyclictest0-21swapper/020:24:460
2756599904,26cyclictest0-21swapper/021:37:020
2756599904,26cyclictest0-21swapper/020:49:200
2756599904,26cyclictest0-21swapper/020:49:200
27565999032,51cyclictest18729-21unixbench_singl18:04:530
27565999032,51cyclictest18729-21unixbench_singl18:04:530
2756599903,80cyclictest19057-21kworker/0:121:24:280
2756599883,26cyclictest0-21swapper/022:44:210
2756599883,26cyclictest0-21swapper/022:44:210
27565998825,55cyclictest0-21swapper/020:59:340
2756599874,76cyclictest0-21swapper/022:19:050
2756599874,75cyclictest0-21swapper/019:39:500
2756599874,75cyclictest0-21swapper/019:25:470
2756599874,71cyclictest20006-21python21:39:410
27565998732,48cyclictest27542-21grep22:39:280
2756599873,77cyclictest0-21swapper/018:44:340
2756599864,74cyclictest0-21swapper/020:39:400
2756599863,76cyclictest0-21swapper/021:13:180
27565998622,56cyclictest0-21swapper/020:21:470
2756599854,74cyclictest0-21swapper/021:44:330
2756599854,74cyclictest0-21swapper/019:58:190
2756599854,24cyclictest0-21swapper/021:56:350
2756599853,75cyclictest0-21swapper/022:34:410
2756599853,75cyclictest0-21swapper/020:34:420
2756599853,74cyclictest0-21swapper/019:29:450
2756599853,74cyclictest0-21swapper/019:29:450
2756599853,72cyclictest0-21swapper/022:23:010
27565998522,8cyclictest31748-21ssh19:34:350
27565998516,7cyclictest20303-21diskmemload21:04:420
27569998434,43cyclictest1021-21runrttasks19:37:003
27569998428,49cyclictest0-21swapper/319:21:583
2756599846,12cyclictest0-21swapper/021:14:470
2756599844,72cyclictest0-21swapper/022:24:390
2756599844,72cyclictest0-21swapper/019:59:410
2756599844,14cyclictest0-21swapper/022:09:350
2756599844,11cyclictest0-21swapper/021:51:400
2756599843,9cyclictest1419-21runrttasks22:03:330
2756599843,73cyclictest0-21swapper/019:20:070
2756599843,29cyclictest0-21swapper/020:54:530
27569998324,51cyclictest0-21swapper/319:26:343
2756599839,14cyclictest0-21swapper/019:49:320
2756599834,28cyclictest0-21swapper/020:17:040
2756599834,26cyclictest0-21swapper/017:29:350
2756599833,73cyclictest0-21swapper/020:10:530
27569998222,52cyclictest0-21swapper/320:03:523
2756599824,33cyclictest0-21swapper/019:49:160
2756599823,27cyclictest0-21swapper/018:59:370
248599820,5rtkit-daemon2484-21rtkit-daemon18:27:092
27569998125,48cyclictest0-21swapper/322:32:423
2756599814,26cyclictest0-21swapper/018:39:360
2756599813,32cyclictest0-21swapper/020:04:360
2756599813,25cyclictest0-21swapper/018:59:030
27565998129,10cyclictest28607-21gltestperf17:19:390
27569998035,27cyclictest9583-21sh17:49:193
27569998032,30cyclictest17589-21awk22:24:313
27569998031,30cyclictest28743-21needreboot19:29:433
27569998031,30cyclictest28743-21needreboot19:29:433
27569998029,33cyclictest0-21swapper/320:54:143
2756599806,28cyclictest23933-21awk18:19:190
2756599804,12cyclictest0-21swapper/018:09:300
2756599803,31cyclictest0-21swapper/018:19:400
27565998026,8cyclictest12229-21aten2.4-expect17:54:320
27565998023,11cyclictest13883-21df_abs19:04:330
27569997929,32cyclictest26894-21cpuspeed22:39:223
27569997928,45cyclictest0-21swapper/317:39:383
27565997919,9cyclictest16749-21crond18:04:190
27569997836,26cyclictest10690-21ssh19:49:493
27569997829,42cyclictest0-21swapper/322:03:433
27569997827,43cyclictest0-21swapper/319:39:173
27569997824,44cyclictest0-21swapper/321:50:213
27569997734,25cyclictest8344-21ssh20:34:433
27569997730,40cyclictest6674-21kworker/3:121:14:483
27569997730,39cyclictest1419-21runrttasks18:05:243
27569997730,39cyclictest1419-21runrttasks18:05:243
27569997730,39cyclictest10990-21tail18:59:283
27569997727,42cyclictest0-21swapper/318:39:403
27569997725,45cyclictest0-21swapper/321:38:093
27569997724,45cyclictest0-21swapper/322:35:033
27569997724,44cyclictest0-21swapper/318:19:383
27569997630,39cyclictest20303-21diskmemload20:39:473
27569997630,31cyclictest6792-21latency_hist20:34:133
27569997628,31cyclictest0-21swapper/318:14:273
27569997627,42cyclictest0-21swapper/321:54:273
27569997627,41cyclictest0-21swapper/322:14:583
27569997625,43cyclictest0-21swapper/319:56:513
27569997624,45cyclictest0-21swapper/318:49:503
27569997624,45cyclictest0-21swapper/318:49:503
27569997623,46cyclictest0-21swapper/320:09:533
27569997620,46cyclictest0-21swapper/321:09:243
2756599764,18cyclictest20305-21munin-run19:19:160
2756599763,31cyclictest28272-21grep18:24:520
27569997534,18cyclictest25769-21aten_r1power_cu20:14:253
27569997532,36cyclictest1419-21runrttasks18:13:503
27569997530,38cyclictest0-21swapper/320:44:353
27569997530,27cyclictest0-21swapper/321:29:373
27569997530,27cyclictest0-21swapper/321:29:373
27569997529,39cyclictest0-21swapper/321:44:003
27569997529,30cyclictest0-21swapper/321:44:353
27569997528,40cyclictest13278-21hostname22:19:213
27569997528,30cyclictest0-21swapper/318:44:373
27569997528,16cyclictest0-21swapper/321:09:133
27569997526,43cyclictest0-21swapper/322:46:163
27569997526,43cyclictest0-21swapper/322:46:163
27569997526,40cyclictest821-21taskset18:36:573
27569997526,30cyclictest0-21swapper/319:44:353
27569997524,33cyclictest0-21swapper/317:34:213
2756599754,29cyclictest0-21swapper/017:39:350
2756599754,23cyclictest0-21swapper/018:49:460
2756599754,23cyclictest0-21swapper/018:49:460
27565997522,8cyclictest32039-21fschecks_time18:34:380
302372740,4sleep330311-21cut17:24:333
302372740,4sleep330311-21cut17:24:333
27569997431,36cyclictest7179-21ssh21:20:453
27569997431,35cyclictest31481-21ssh20:21:283
27569997430,37cyclictest1287-21snmpd22:04:263
27569997430,37cyclictest1287-21snmpd22:04:263
27569997430,28cyclictest19024-21munin-node20:04:333
27569997427,28cyclictest9102-21runrttasks21:24:313
27565997425,8cyclictest29702-21fschecks_time18:29:360
27569997326,40cyclictest0-21swapper/320:49:183
27569997326,40cyclictest0-21swapper/320:49:183
27569997325,41cyclictest0-21swapper/320:28:353
2756599734,23cyclictest0-21swapper/017:54:190
27569997235,30cyclictest16596-21sshd18:02:253
27569997233,32cyclictest26674-21rm21:03:163
27569997223,41cyclictest0-21swapper/319:10:043
27569997223,33cyclictest0-21swapper/322:12:153
2756599724,23cyclictest0-21swapper/017:34:520
2756599724,12cyclictest0-21swapper/019:10:240
27569997132,32cyclictest0-21swapper/318:30:083
2756599713,28cyclictest0-21swapper/017:24:550
2756599713,28cyclictest0-21swapper/017:24:550
27569997027,36cyclictest0-21swapper/317:34:463
27569997026,38cyclictest0-21swapper/317:49:383
248599700,5rtkit-daemon0-21swapper/117:46:250
27569996921,41cyclictest0-21swapper/319:04:493
2756799694,57cyclictest0-21swapper/120:19:341
2756899684,55cyclictest0-21swapper/221:59:352
2756799684,56cyclictest0-21swapper/120:25:551
27569996748,13cyclictest28808-21iostat_ios17:19:433
2756899676,51cyclictest19316-21perl21:39:292
2756899674,54cyclictest0-21swapper/222:14:222
2756899674,54cyclictest0-21swapper/222:09:422
27569996630,17cyclictest121850irq/46-eth018:54:423
27569996625,28cyclictest0-21swapper/317:58:253
27569996522,36cyclictest1419-21runrttasks19:15:213
2756899654,53cyclictest0-21swapper/219:29:562
2756899654,53cyclictest0-21swapper/219:29:562
2756899653,54cyclictest0-21swapper/222:32:532
15892650,4sleep21694-21timerandwakeup17:29:522
27569996428,20cyclictest0-21swapper/318:24:313
2756899644,52cyclictest0-21swapper/219:39:492
2756899644,43cyclictest0-21swapper/222:39:452
2756899643,53cyclictest0-21swapper/221:14:272
2756899634,52cyclictest0-21swapper/221:26:082
2756899634,52cyclictest0-21swapper/220:04:322
2756799634,37cyclictest0-21swapper/118:34:191
2756899624,51cyclictest0-21swapper/219:44:282
2756899624,49cyclictest0-21swapper/219:34:352
27567996244,12cyclictest0-21swapper/120:49:261
27567996244,12cyclictest0-21swapper/120:49:261
2756799623,52cyclictest0-21swapper/121:03:551
2756899614,50cyclictest16339-21latency_hist22:24:102
2756899614,50cyclictest0-21swapper/220:48:182
2756899614,33cyclictest0-21swapper/221:39:122
2756899613,52cyclictest0-21swapper/219:59:572
2756899613,50cyclictest0-21swapper/220:59:262
27567996121,13cyclictest0-21swapper/121:14:321
2756899604,49cyclictest4559-21grep20:29:352
2756899603,47cyclictest281ktimersoftd/219:24:332
2756799604,38cyclictest0-21swapper/119:37:041
2756799603,51cyclictest0-21swapper/122:41:011
2756799603,51cyclictest0-21swapper/121:32:111
2756799603,51cyclictest0-21swapper/121:32:111
2756799603,50cyclictest0-21swapper/121:39:431
2756799603,50cyclictest0-21swapper/121:07:021
27569995932,21cyclictest0-21swapper/317:19:213
27568995941,11cyclictest26117-21grep21:49:312
2756899594,48cyclictest0-21swapper/221:29:472
2756899594,48cyclictest0-21swapper/221:29:472
2756799593,50cyclictest0-21swapper/122:18:371
2756799593,50cyclictest0-21swapper/120:36:151
2756799593,49cyclictest0-21swapper/120:44:561
2756799593,49cyclictest0-21swapper/120:03:081
2756799593,23cyclictest0-21swapper/121:44:381
2756899584,48cyclictest1419-21runrttasks20:53:022
2756899584,48cyclictest1419-21runrttasks20:53:022
2756899584,46cyclictest0-21swapper/222:44:232
2756899584,46cyclictest0-21swapper/222:44:232
27568995838,13cyclictest0-21swapper/220:24:372
27568995812,27cyclictest0-21swapper/221:13:052
2756799589,28cyclictest0-21swapper/119:29:161
27567995841,12cyclictest0-21swapper/120:33:451
27567995830,13cyclictest0-21swapper/122:19:431
2756799583,49cyclictest0-21swapper/122:33:591
2756799583,49cyclictest0-21swapper/121:21:171
2756799583,49cyclictest0-21swapper/119:55:231
2756799583,49cyclictest0-21swapper/118:15:151
2756799582,50cyclictest0-21swapper/122:26:031
2756899575,34cyclictest0-21swapper/219:49:442
2756899574,47cyclictest0-21swapper/221:44:562
2756899574,47cyclictest0-21swapper/219:54:332
2756899574,46cyclictest0-21swapper/221:22:302
2756899574,46cyclictest0-21swapper/219:19:462
2756899574,45cyclictest0-21swapper/222:24:242
2756799577,42cyclictest0-21swapper/121:09:171
2756799573,49cyclictest0-21swapper/122:12:181
2756799573,49cyclictest0-21swapper/122:00:341
2756799573,49cyclictest0-21swapper/121:34:131
2756799573,49cyclictest0-21swapper/120:05:421
2756799573,49cyclictest0-21swapper/119:45:171
2756799573,49cyclictest0-21swapper/119:29:341
2756799573,49cyclictest0-21swapper/119:29:341
2756799573,49cyclictest0-21swapper/119:22:121
2756799573,48cyclictest0-21swapper/121:49:181
2756799573,47cyclictest0-21swapper/121:55:001
2756799573,47cyclictest0-21swapper/120:14:381
2756799573,47cyclictest0-21swapper/119:43:571
27567995728,13cyclictest0-21swapper/120:40:371
27567995714,26cyclictest0-21swapper/122:36:141
2756899564,46cyclictest19606-21kworker/2:122:34:272
2756899563,36cyclictest0-21swapper/220:19:372
2756899562,9cyclictest0-21swapper/220:35:552
2756899562,39cyclictest0-21swapper/217:24:292
2756899562,39cyclictest0-21swapper/217:24:292
2756799563,48cyclictest0-21swapper/122:48:231
2756799563,48cyclictest0-21swapper/122:48:231
231402563,12sleep10-21swapper/120:09:341
2756899555,27cyclictest0-21swapper/220:39:302
2756899554,45cyclictest0-21swapper/221:56:142
2756899554,12cyclictest0-21swapper/220:54:512
27568995537,11cyclictest15050-21unixbench_multi19:04:502
2756799555,29cyclictest0-21swapper/117:59:321
2756799553,47cyclictest0-21swapper/120:56:121
2756799553,47cyclictest0-21swapper/119:52:081
2756799553,45cyclictest0-21swapper/119:04:281
2756899543,45cyclictest0-21swapper/218:14:272
2756899543,45cyclictest0-21swapper/217:39:422
2756899542,11cyclictest0-21swapper/222:07:172
2756899542,11cyclictest0-21swapper/222:07:172
2756799544,30cyclictest0-21swapper/121:29:111
2756799543,44cyclictest0-21swapper/118:39:291
2756799542,46cyclictest0-21swapper/118:59:441
2756899534,43cyclictest0-21swapper/218:34:322
27568995337,10cyclictest6524-21grep18:49:302
27568995337,10cyclictest6524-21grep18:49:302
27568995335,11cyclictest3858-21tr17:34:452
2756899533,9cyclictest1419-21runrttasks20:10:252
2756899524,41cyclictest0-21swapper/221:04:292
2756899524,41cyclictest0-21swapper/219:09:302
2756899523,43cyclictest0-21swapper/219:14:282
27568995221,13cyclictest0-21swapper/218:04:532
27568995221,13cyclictest0-21swapper/218:04:532
2756799525,29cyclictest0-21swapper/118:44:531
2756799524,27cyclictest0-21swapper/118:20:151
2756799523,42cyclictest0-21swapper/118:54:301
27567995221,13cyclictest0-21swapper/118:50:201
27567995221,13cyclictest0-21swapper/118:50:201
200702523,11sleep10-21swapper/119:16:251
106882522,43sleep20-21swapper/218:58:532
57202513,9sleep20-21swapper/218:46:192
2756899514,40cyclictest0-21swapper/217:24:212
2756899514,30cyclictest0-21swapper/218:09:492
2756899514,27cyclictest0-21swapper/218:59:322
2756899513,10cyclictest0-21swapper/218:30:062
27568995119,14cyclictest0-21swapper/218:19:352
2756799514,26cyclictest0-21swapper/118:34:431
272282514,41sleep00-21swapper/017:15:250
175662513,42sleep10-21swapper/119:10:041
2756899504,30cyclictest0-21swapper/217:59:452
2756899504,29cyclictest0-21swapper/217:49:392
27568995018,12cyclictest0-21swapper/217:45:092
27568995017,13cyclictest0-21swapper/217:54:542
2756799504,27cyclictest0-21swapper/118:24:311
27567994725,15cyclictest0-21swapper/117:29:471
27568994631,9cyclictest1444-21aten2.4-expect18:39:312
2756899402,24cyclictest0-21swapper/217:19:222
2756799376,12cyclictest0-21swapper/117:19:211
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional