You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-21 - 11:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7s.osadl.org (updated Tue Jul 21, 2026 00:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
62662337411,3350sleep31318-21kworker/3:022:37:343
17143260212,523sleep017182-21fschecks_count21:28:400
54125848,563sleep0577-21ntpq22:18:460
18368251736,464sleep018474-21ls23:13:520
2438224196,400sleep024426-21ntpq23:33:460
26077239515,366sleep226154-21unin-run21:58:212
8157237917,348sleep28168-21ntpq20:58:472
2500234217,308sleep22546-21unin-run20:43:212
2500234217,308sleep22546-21unin-run20:43:212
339232373,194sleep0506-21unixbench_multi20:33:540
339232373,194sleep0506-21unixbench_multi20:33:540
4092231650,252sleep00-21swapper/022:29:150
20774230411,278sleep020859-21latency_hist19:58:220
23750226922,41sleep00-21swapper/021:48:500
2195224949,123sleep00-21swapper/000:08:210
217642242177,46sleep021824-21mailstats19:58:540
217642242177,46sleep021824-21mailstats19:58:540
15509222717,191sleep115501-21apt-get21:23:361
15509222717,191sleep115501-21apt-get21:23:361
2015322199,199sleep020164-21sort21:38:330
1983221513,185sleep02129-21unixbench_singl20:38:550
1983221513,185sleep02129-21unixbench_singl20:38:550
16762221513,152sleep016765-21cron21:28:200
16762221513,152sleep016765-21cron21:28:200
28451221020,173sleep128530-21awk22:03:491
28390220210,59sleep027451-21/usr/sbin/munin20:18:570
28390220210,59sleep027451-21/usr/sbin/munin20:18:570
2374222019,154sleep023798-21sed23:33:210
11291220185,56sleep00-21swapper/022:53:370
19949219414,129sleep020060-21sort23:18:520
8676219390,55sleep00-21swapper/000:28:360
2500721926,174sleep025059-21cat21:53:430
2873218550,57sleep00-21swapper/020:43:390
2873218550,57sleep00-21swapper/020:43:390
37121786,11sleep00-21swapper/000:00:340
9742217223,129sleep39743-21cpu22:48:363
28097217228,61sleep00-21swapper/022:03:400
6802216720,81sleep00-21swapper/019:13:290
5333216442,108sleep05349-21uname22:33:430
22127216412,75sleep022172-21ntpq21:43:460
22127216412,75sleep022172-21ntpq21:43:460
12867216332,84sleep00-21swapper/022:58:380
27333216056,47sleep00-21swapper/023:43:430
9635215947,50sleep00-21swapper/021:03:460
9635215947,50sleep00-21swapper/021:03:460
24428215810,135sleep024453-21fschecks_count20:08:390
3743215743,73sleep03840-21latency_hist00:13:220
4100215616,14sleep20-21swapper/200:13:402
29259215514,125sleep229229-21latency_hist22:08:222
19512215325,104sleep219543-21fschecks_count19:53:402
8380215137,51sleep08383-21cron00:28:200
6917215148,47sleep00-21swapper/022:38:440
4563215110,116sleep00-21swapper/000:13:510
2597021507,95sleep00-21swapper/020:13:400
2597021507,95sleep00-21swapper/020:13:400
10309214347,52sleep00-21swapper/000:33:410
31457214212,80sleep031460-21cron23:58:200
26808214122,75sleep00-21swapper/021:58:470
14867213929,72sleep00-21swapper/019:38:400
30329213720,103sleep130412-21wc20:28:221
17464213712,71sleep017474-21modprobe23:13:190
17464213712,71sleep017474-21modprobe23:13:190
18497213615,17sleep00-21swapper/019:48:530
18497213615,17sleep00-21swapper/019:48:530
31597213513,107sleep331719-21latency_hist23:58:233
10153213227,44sleep00-21swapper/019:23:420
347121319,17sleep00-21swapper/022:28:390
347121319,17sleep00-21swapper/022:28:390
3160921278,71sleep0364-21snmpd20:30:350
2686621259,62sleep026996-21cat23:43:230
1433221205,102sleep00-21swapper/021:18:470
29391211710,51sleep00-21swapper/020:23:450
21539211720,71sleep10-21swapper/121:43:221
21539211720,71sleep10-21swapper/121:43:221
2896211444,49sleep32918-21/usr/sbin/munin00:08:493
11882211340,18sleep00-21swapper/021:10:440
13395211029,67sleep013400-21cron21:15:200
8197210952,40sleep00-21swapper/022:43:360
23955210718,74sleep324091-21awk21:48:543
17453210544,48sleep0225-21systemd-journal19:46:350
17453210544,48sleep0225-21systemd-journal19:46:350
1086321055,17sleep00-21swapper/022:51:360
8369210414,75sleep18414-21idleruntime22:43:411
18362210416,72sleep218429-21cat21:33:222
1721210414,74sleep21895-21cat22:23:242
1721210414,74sleep21895-21cat22:23:242
7206210314,15sleep00-21swapper/020:55:580
7206210314,15sleep00-21swapper/020:55:580
12460210224,52sleep112498-21grep21:13:391
4343210143,45sleep04330-21apt-get20:48:400
31136210127,42sleep331208-21fschecks_time22:13:403
1572210017,65sleep11455-21latency_hist22:23:231
590429918,70sleep00-21swapper/019:09:130
1442329815,69sleep314477-21sort23:03:373
2209529710,11sleep30-21swapper/321:43:453
2209529710,11sleep30-21swapper/321:43:453
3102829621,20sleep10-21swapper/120:28:471
366829418,62sleep23747-21cut22:29:052
897529328,48sleep39002-21grep21:03:203
1367129325,46sleep313713-21wc19:33:513
3075729239,15sleep01-21systemd22:13:210
860129114,57sleep28491-21/usr/sbin/munin19:18:402
3154829118,60sleep131608-21tr22:13:501
1437829121,51sleep114414-21ntp_states21:18:481
109792916,11sleep30-21swapper/319:23:583
85729018,57sleep1868-21acpi00:03:301
578629029,41sleep00-21swapper/000:18:430
1143928915,56sleep111522-21timerandwakeup21:08:511
856928821,14sleep00-21swapper/019:18:380
2218328822,13sleep00-21swapper/023:28:210
992928720,48sleep39955-21munin-plugin-st00:33:203
442928725,33sleep10-21swapper/120:48:451
2038828719,51sleep220438-21/usr/sbin/munin21:38:432
1128828714,53sleep210801-21/usr/sbin/munin21:08:482
1349928622,46sleep113576-21/usr/sbin/munin19:33:441
777428529,14sleep00-21swapper/020:58:370
488628516,53sleep15029-21latency_hist22:33:241
1681428515,51sleep216787-21latency_hist21:28:222
1681428515,51sleep216787-21latency_hist21:28:222
2455828414,57sleep124634-21switchtime23:33:511
2219428423,47sleep122165-21latency_hist23:28:221
146052848,18sleep00-21swapper/023:03:430
828728312,56sleep28435-21cat19:18:232
2402528333,40sleep00-21swapper/020:07:590
1847628318,32sleep10-21swapper/123:13:531
1104728323,18sleep10-21swapper/122:53:221
953928213,32sleep30-21swapper/321:03:443
953928213,32sleep30-21swapper/321:03:443
406228223,32sleep00-21swapper/019:03:530
406228223,32sleep00-21swapper/019:03:530
1857628214,49sleep00-21swapper/021:33:330
1454628223,41sleep00-21swapper/019:38:240
2910828123,36sleep329190-21fschecks_time20:23:403
2556528127,36sleep325706-21grep21:53:543
202122810,6sleep30-21swapper/319:53:523
3272328013,48sleep3335-21timerandwakeup20:33:533
3272328013,48sleep3335-21timerandwakeup20:33:533
1824928016,30sleep10-21swapper/119:48:461
1824928016,30sleep10-21swapper/119:48:461
1620928019,39sleep216246-21grep23:08:372
1620928019,39sleep216246-21grep23:08:372
1138728020,38sleep111416-21fschecks_count22:53:421
2841427923,28sleep30-21swapper/323:48:223
795627819,43sleep28017-21latency_hist22:43:222
387927723,31sleep23963-21awk19:03:512
387927723,31sleep23963-21awk19:03:512
2785327720,42sleep127903-21awk20:18:451
2785327720,42sleep127903-21awk20:18:451
263972777,18sleep20-21swapper/221:58:372
1779727716,35sleep117940-21grep21:28:531
120292777,13sleep00-21swapper/019:28:470
194927612,48sleep31951-21apt-get22:23:333
194927612,48sleep31951-21apt-get22:23:333
998127517,40sleep210110-21ls00:33:232
2181327523,25sleep20-21swapper/221:43:402
2181327523,25sleep20-21swapper/221:43:402
1456827516,46sleep214664-21timerandwakeup21:18:532
722127420,31sleep20-21swapper/200:23:422
667127424,23sleep30-21swapper/300:21:163
3104327420,13sleep00-21swapper/022:13:330
1209527423,25sleep30-21swapper/319:28:503
851627316,37sleep38567-21/usr/sbin/munin19:18:373
826727319,32sleep18285-21latency_hist19:18:221
610527321,29sleep10-21swapper/120:53:331
610527321,29sleep10-21swapper/120:53:331
2975127353,10sleep00-21swapper/023:51:180
214327321,33sleep22158-21idleruntime-cro00:08:192
2627027219,37sleep326318-21ntpq20:13:473
2627027219,37sleep326318-21ntpq20:13:473
1609327220,23sleep30-21swapper/319:43:233
91827124,26sleep20-21swapper/220:38:202
91827124,26sleep20-21swapper/220:38:202
2800427120,37sleep328055-21awk20:18:513
2800427120,37sleep328055-21awk20:18:513
2064427122,21sleep10-21swapper/123:23:211
1767827116,39sleep217824-21cat19:48:232
1546527120,35sleep115615-21sed19:38:531
631927015,28sleep20-21swapper/219:13:232
2619527014,40sleep326323-21sed23:38:493
2334927016,28sleep10-21swapper/121:48:391
1099327019,21sleep10-21swapper/100:33:541
88726914,36sleep31026-21/usr/sbin/munin22:18:533
2996126929,21sleep30-21swapper/323:53:233
2471026912,27sleep10-21swapper/120:08:441
2463626917,24sleep20-21swapper/223:33:522
1827326919,24sleep20-21swapper/219:48:472
1827326919,24sleep20-21swapper/219:48:472
1489926915,28sleep10-21swapper/123:03:521
1396326910,14sleep30-21swapper/321:18:383
1051926923,31sleep210528-21modprobe21:08:202
1051926923,31sleep210528-21modprobe21:08:202
1043726926,28sleep20-21swapper/219:23:482
95022687,38sleep10-21swapper/100:28:541
224062689,12sleep20-21swapper/223:28:312
2018226711,16sleep10-21swapper/121:38:381
664926620,28sleep16640-21apt-get22:38:371
843326518,24sleep30-21swapper/300:28:233
627426520,28sleep11-21systemd19:13:221
505326516,25sleep30-21swapper/319:08:403
359826518,21sleep30-21swapper/322:28:463
3065326515,33sleep230659-21ntp_states23:53:462
2715526520,28sleep127157-21cron20:18:211
2715526520,28sleep127157-21cron20:18:211
1909926521,27sleep20-21swapper/223:18:222
1867526513,35sleep218684-21df_inode21:33:392
1571426522,27sleep215742-21munin-run23:08:212
691826419,30sleep27046-21/usr/sbin/munin20:54:072
691826419,30sleep27046-21/usr/sbin/munin20:54:072
578826419,19sleep30-21swapper/320:53:233
2911526419,27sleep229137-21/usr/sbin/munin23:48:502
1557926418,24sleep30-21swapper/321:23:393
1557926418,24sleep30-21swapper/321:23:393
78226320,30sleep2886-21sed22:18:522
396526316,28sleep33361-21/usr/sbin/munin19:03:523
396526316,28sleep33361-21/usr/sbin/munin19:03:523
2719126324,19sleep20-21swapper/223:43:412
2564926319,22sleep30-21swapper/320:13:223
243526318,28sleep22427-21apt-get00:08:362
1301926315,29sleep313133-21timerwakeupswit21:13:543
2405126216,30sleep124053-21cron20:08:201
1629226213,21sleep10-21swapper/123:08:401
1629226213,21sleep10-21swapper/123:08:401
471426116,29sleep24748-21/usr/sbin/munin20:48:502
327026117,27sleep20-21swapper/220:43:492
327026117,27sleep20-21swapper/220:43:492
3131326120,21sleep20-21swapper/222:13:432
142526113,33sleep11471-21idleruntime20:38:441
142526113,33sleep11471-21idleruntime20:38:441
1307326117,20sleep10-21swapper/122:58:431
1034626122,17sleep20-21swapper/222:48:512
406826021,24sleep10-21swapper/100:13:391
338826017,26sleep13379-21apt-get19:03:371
338826017,26sleep13379-21apt-get19:03:371
298826015,27sleep10-21swapper/100:08:511
2192126020,19sleep20-21swapper/219:58:562
2192126020,19sleep20-21swapper/219:58:562
1887226021,25sleep318891-21sed21:33:443
3175425918,27sleep231770-21awk23:58:302
275362595,44sleep10-21swapper/122:01:431
2482825923,18sleep20-21swapper/220:08:492
1028925917,24sleep210300-21df_inode00:33:392
2957325812,18sleep30-21swapper/322:08:393
2737525812,33sleep127462-21sed23:43:441
254725818,23sleep30-21swapper/320:43:223
254725818,23sleep30-21swapper/320:43:223
228002586,11sleep30-21swapper/323:28:443
1624725816,17sleep30-21swapper/323:08:383
1624725816,17sleep30-21swapper/323:08:383
585025710,17sleep20-21swapper/200:18:452
2862625717,19sleep30-21swapper/322:03:513
2676625718,19sleep30-21swapper/321:58:463
141125716,15sleep30-21swapper/300:03:483
1188425710,13sleep10-21swapper/119:28:441
685825613,23sleep30-21swapper/322:38:433
557625614,25sleep15570-21apt-get00:18:361
3230125613,28sleep132331-21idleruntime20:33:431
3230125613,28sleep132331-21idleruntime20:33:431
2625725616,24sleep226269-21/usr/sbin/munin20:13:462
2625725616,24sleep226269-21/usr/sbin/munin20:13:462
2256125614,19sleep10-21swapper/120:03:231
2256125614,19sleep10-21swapper/120:03:231
1783025615,25sleep317839-21diskstats23:13:393
1651525621,21sleep10-21swapper/119:43:411
1651525621,21sleep10-21swapper/119:43:411
1496625615,21sleep20-21swapper/219:38:422
1282825616,24sleep212829-21ntp_states21:13:492
101122566,11sleep30-21swapper/300:33:243
819425513,26sleep38188-21apt-get22:43:353
58625517,21sleep30-21swapper/300:03:203
3098225518,22sleep331019-21ntp_states20:28:443
2902025513,24sleep229014-21apt-get20:23:352
2827925511,17sleep20-21swapper/220:18:552
2827925511,17sleep20-21swapper/220:18:552
2612425520,20sleep20-21swapper/223:38:482
2410125517,17sleep30-21swapper/320:08:223
1982325519,19sleep20-21swapper/223:18:502
1762425517,24sleep317670-21awk21:28:513
851425414,24sleep18509-21apt-get19:18:351
773925418,18sleep10-21swapper/100:23:531
397925415,23sleep33976-21apt-get00:13:333
3083525416,20sleep20-21swapper/222:13:232
3080125419,16sleep10-21swapper/122:13:221
2536925411,18sleep10-21swapper/121:53:521
241932546,36sleep20-21swapper/221:49:012
2345725414,15sleep20-21swapper/220:03:532
2053525419,19sleep30-21swapper/323:22:353
2000025421,21sleep10-21swapper/119:53:511
701225315,19sleep30-21swapper/319:13:403
3136925310,17sleep20-21swapper/220:28:522
2873925313,24sleep10-21swapper/123:48:401
115852539,16sleep20-21swapper/219:28:332
860225212,23sleep28647-21ntp_states22:43:462
2251125112,24sleep122517-21diskstats23:28:381
2214125115,18sleep30-21swapper/323:28:203
19692517,35sleep10-21swapper/122:23:391
19692517,35sleep10-21swapper/122:23:391
1424225116,21sleep2225-21systemd-journal19:35:312
1167625113,22sleep311729-21users21:08:533
573225012,22sleep15857-21cat22:33:521
553425016,18sleep20-21swapper/222:33:492
324925015,19sleep10-21swapper/120:43:481
324925015,19sleep10-21swapper/120:43:481
3219825012,15sleep10-21swapper/123:58:461
278425011,22sleep32779-21apt-get20:43:343
278425011,22sleep32779-21apt-get20:43:343
2203625011,15sleep30-21swapper/319:58:573
2203625011,15sleep30-21swapper/319:58:573
2025825015,20sleep320264-21diskstats21:38:403
1845425014,18sleep30-21swapper/319:48:523
1845425014,18sleep30-21swapper/319:48:523
1674025011,16sleep20-21swapper/219:43:472
1286525011,23sleep312858-21apt-get22:58:373
792924912,22sleep17978-21irqstats20:58:421
2096224912,22sleep220969-21diskstats23:23:392
1860724912,22sleep118674-21df21:33:381
1128824912,21sleep211282-21apt-get22:53:352
3063024811,22sleep130652-21ntp_states23:53:451
2604124811,17sleep10-21swapper/123:38:471
1294224810,15sleep20-21swapper/222:58:402
1021324610,14sleep10-21swapper/119:23:431
931924519,13sleep10-21swapper/121:03:381
931924519,13sleep10-21swapper/121:03:381
1235924513,15sleep30-21swapper/322:55:593
609924412,19sleep35616-21apt-get20:53:313
609924412,19sleep35616-21apt-get20:53:313
2476324210,14sleep30-21swapper/323:33:533
167862367,14sleep30-21swapper/319:43:483
167862367,14sleep30-21swapper/319:43:483
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional