You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-31 - 17:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7s.osadl.org (updated Wed Dec 31, 2025 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
186032208110,2057sleep39490-21kworker/3:112:33:393
22365275111,721sleep122481-21/usr/sbin/munin07:34:271
22365275111,721sleep122481-21/usr/sbin/munin07:34:271
6707259014,559sleep06751-21ntpq08:29:230
21808246163,32sleep20-21swapper/207:34:162
21808246163,32sleep20-21swapper/207:34:162
909724340,12sleep09098-21latency10:19:230
17121237812,149sleep20-21swapper/210:44:262
2426823598,293sleep224316-21grep11:09:132
294472323140,86sleep20-21swapper/211:24:242
294472323140,86sleep20-21swapper/211:24:242
841225445,189sleep2921-21fschecks_time09:54:182
29884224411,217sleep029925-21ntpq07:59:220
12420223040,88sleep20-21swapper/210:29:272
3011222737,71sleep23155-21apt-config11:43:582
27322222710,202sleep227397-21wc09:34:272
10068222371,57sleep20-21swapper/210:23:582
21443221752,48sleep20-21swapper/210:59:202
3222221532,55sleep20-21swapper/208:19:072
27969221326,175sleep227983-21grep11:20:122
15652220913,181sleep215687-21latency_hist08:58:572
11767220916,173sleep011795-21kernelversion07:04:220
13932220517,132sleep2372-21sshd12:18:272
13932220517,132sleep2372-21sshd12:18:272
20546219410,171sleep320590-21awk07:29:243
20142219254,46sleep20-21swapper/207:29:072
2220921917,55sleep20-21swapper/209:19:162
14427219111,163sleep00-21swapper/008:54:270
20346218911,116sleep20-21swapper/210:54:312
18681218518,56sleep20-21swapper/212:33:582
32262217916,145sleep132256-21apt-get11:34:121
937121668,46sleep20-21swapper/212:03:572
1892121619,37sleep20-21swapper/212:34:142
1892121619,37sleep20-21swapper/212:34:142
5213215830,116sleep25227-21uname11:49:192
58421579,84sleep232237-21/usr/sbin/munin11:34:292
24958215310,106sleep224992-21latency_hist09:28:582
7599215212,47sleep20-21swapper/210:14:372
2975921529,16sleep20-21swapper/207:59:202
1253221476,34sleep20-21swapper/208:49:082
72821467,125sleep2820-21cat08:09:262
15185214631,103sleep215197-21vmstat12:19:282
15185214631,103sleep215197-21vmstat12:19:282
21149214512,110sleep20-21swapper/209:14:282
17138214318,14sleep20-21swapper/212:28:572
17138214318,14sleep20-21swapper/212:28:572
3447214031,95sleep23388-21apt-get11:44:472
17447214021,102sleep20-21swapper/209:04:102
908621398,121sleep2369-21snmpd08:38:212
23885213428,93sleep223980-21sed07:39:252
32331213331,89sleep232350-21wc08:08:572
2872821299,22sleep30-21swapper/307:54:283
17210212949,65sleep217319-21sed09:03:582
28962212821,86sleep129103-21sort11:23:581
29547212717,90sleep029148-21/usr/sbin/munin11:24:260
29547212717,90sleep029148-21/usr/sbin/munin11:24:260
11557212755,24sleep20-21swapper/210:28:552
660721269,14sleep20-21swapper/208:29:212
19394212614,96sleep119457-21ps12:34:291
19394212614,96sleep119457-21ps12:34:291
16123212528,41sleep2369-21snmpd07:16:432
11533212511,100sleep211579-21ntpq12:09:232
2870121248,15sleep20-21swapper/209:39:322
2870121248,15sleep20-21swapper/209:39:322
59721237,103sleep0369-21snmpd08:09:240
13187212311,96sleep30-21swapper/307:09:173
11499212023,36sleep20-21swapper/208:44:272
18182211618,73sleep318330-21grep09:04:273
645521155,10sleep20-21swapper/210:11:222
14657211521,34sleep20-21swapper/210:38:562
26075211419,81sleep20-21swapper/211:14:182
16880211315,78sleep316839-21apt-get07:19:353
22724211213,16sleep10-21swapper/111:04:111
11609211220,71sleep011693-21latency_hist10:28:570
28527211119,73sleep128017-21apt-get09:39:061
28527211119,73sleep128017-21apt-get09:39:061
18152211031,38sleep218292-21sed07:23:582
1851121097,14sleep20-21swapper/210:49:222
12983210918,75sleep113047-21latency12:14:221
12983210918,75sleep113047-21latency12:14:221
20149210823,38sleep00-21swapper/007:29:090
24714210616,74sleep124724-21ntp_states11:09:241
14065210618,65sleep114176-21cat10:34:271
5395210524,65sleep25472-21xargs08:24:282
30477210420,64sleep330449-21latency_hist11:28:573
30477210420,64sleep330449-21latency_hist11:28:573
28033210118,64sleep31-21systemd09:38:563
12527210120,63sleep10-21swapper/108:49:071
31170210021,36sleep20-21swapper/211:29:242
22491210020,61sleep30-21swapper/309:19:213
383129711,38sleep20-21swapper/210:04:072
2209629717,63sleep122104-21/usr/sbin/munin09:19:071
913129615,66sleep09184-21sendmail-msp08:38:560
337029516,56sleep32886-21apt-get11:44:073
3010629530,47sleep030161-21cpuspeed09:44:140
227429516,56sleep31645-21/usr/sbin/munin08:14:273
2695329418,59sleep127003-21if_eth009:34:181
2661229421,12sleep20-21swapper/207:49:182
2006029410,16sleep10-21swapper/110:54:261
198512949,69sleep219975-21cat07:28:592
198512949,69sleep219975-21cat07:28:592
986029320,35sleep20-21swapper/208:39:222
321422936,28sleep20-21swapper/209:49:252
2986329313,64sleep029934-21latency_hist09:43:580
2986329313,64sleep029934-21latency_hist09:43:580
1274929231,38sleep212784-21munin-run07:08:562
969929112,66sleep19765-21fschecks_time12:04:171
1328829113,60sleep013338-21/usr/sbin/munin07:09:180
305229025,16sleep20-21swapper/208:18:592
1316529016,20sleep20-21swapper/207:09:162
3163828915,28sleep131640-21apt-get09:49:081
575128810,19sleep00-21swapper/011:49:300
2580428831,26sleep20-21swapper/207:45:232
1167628818,50sleep011809-21sed08:44:290
470728721,47sleep04793-21latency_hist11:48:570
2303628717,57sleep322988-21latency_hist07:38:583
2303628717,57sleep322988-21latency_hist07:38:583
458528619,52sleep34629-21timerwakeupswit10:04:293
1557228612,58sleep015650-21find10:39:270
115922869,61sleep311672-21find08:44:283
658728528,30sleep30-21swapper/311:54:173
658728528,30sleep30-21swapper/311:54:173
2538828521,19sleep20-21swapper/209:29:182
1946528542,24sleep20-21swapper/209:09:272
1233628523,39sleep10-21swapper/110:29:261
279132848,32sleep20-21swapper/207:54:112
150242847,66sleep215043-21df10:39:132
777928330,25sleep30-21swapper/310:14:423
703428312,41sleep10-21swapper/111:54:271
703428312,41sleep10-21swapper/111:54:271
630928321,48sleep16323-21acpi08:29:071
287128223,41sleep0228-21systemd-journal11:43:560
1558128215,42sleep1287-21dbus-daemon08:58:561
2520628125,26sleep10-21swapper/109:29:131
1040528117,46sleep110504-21grep10:24:171
787728015,38sleep30-21swapper/308:34:103
1900428025,33sleep118998-21apt-get09:09:141
1753128018,21sleep00-21swapper/007:20:290
1308228025,30sleep30-21swapper/312:14:243
1308228025,30sleep30-21swapper/312:14:243
1157128029,24sleep10-21swapper/107:04:151
755627919,27sleep20-21swapper/211:56:302
755627919,27sleep20-21swapper/211:56:302
329527918,28sleep20-21swapper/210:00:242
3115827918,30sleep20-21swapper/209:46:222
2778827916,39sleep327874-21grep11:20:093
1390327915,46sleep313974-21/usr/sbin/munin10:34:253
1299927915,52sleep013007-21ntp_states08:49:220
937427819,31sleep30-21swapper/310:19:313
300827822,25sleep10-21swapper/108:18:581
2477327818,35sleep024860-21sshd11:09:270
1960227811,52sleep00-21swapper/010:54:130
190882788,49sleep00-21swapper/007:24:290
190882788,49sleep00-21swapper/007:24:290
1653127818,42sleep016727-21latency_hist07:18:590
1170827824,22sleep30-21swapper/307:04:213
549427715,45sleep35581-21tune2fs10:09:173
293227718,27sleep00-21swapper/008:18:570
2581727720,29sleep00-21swapper/009:29:280
2348827721,28sleep00-21swapper/009:23:590
832927610,52sleep30-21swapper/311:59:183
2707027619,38sleep327101-21awk11:18:553
2373327618,26sleep20-21swapper/211:05:462
1035827641,21sleep210507-21grep12:04:302
2791227518,36sleep127905-21apt-get07:54:101
1617527513,46sleep116265-21memory08:59:201
162322749,51sleep016270-21ntpq12:24:230
162322749,51sleep016270-21ntpq12:24:230
1365527419,26sleep10-21swapper/107:09:271
35627318,35sleep1393-21/usr/sbin/munin08:09:171
2717027317,35sleep127294-21latency_hist11:18:571
2403027317,38sleep324175-21sed11:08:583
1699127325,28sleep00-21swapper/010:44:240
1563427318,29sleep30-21swapper/312:23:573
113622738,47sleep10-21swapper/108:44:221
624627218,28sleep30-21swapper/311:53:573
455227218,34sleep14608-21latency_hist08:23:591
2129327216,39sleep321316-21fschecks_count10:59:173
2265727115,39sleep022728-21sensors09:19:260
1629427118,34sleep116320-21munin-run07:18:561
545627024,24sleep10-21swapper/111:49:271
3037727013,41sleep330471-21/usr/sbin/munin09:44:213
1503127022,30sleep115171-21sshd12:19:271
1503127022,30sleep115171-21sshd12:19:271
1179327022,33sleep011911-21wc12:09:290
258542695,51sleep00-21swapper/007:46:010
2710626815,39sleep027169-21unin-run11:18:560
2405326815,27sleep30-21swapper/309:24:223
1746226821,27sleep00-21swapper/012:29:150
1640226819,29sleep316525-21apt-config07:18:583
1629726816,31sleep316339-21awk08:59:223
1480926817,29sleep30-21swapper/308:54:423
3235126713,13sleep30-21swapper/308:08:583
2102026714,25sleep00-21swapper/009:14:260
2017026720,29sleep320196-21munin-run12:38:563
2017026720,29sleep320196-21munin-run12:38:563
2374826624,24sleep10-21swapper/109:24:161
3016226514,24sleep10-21swapper/109:44:151
702026422,19sleep30-21swapper/308:29:303
3043026413,27sleep10-21swapper/107:59:561
237826421,19sleep10-21swapper/109:59:131
2168326416,31sleep121774-21mailstats10:59:271
1805826415,26sleep30-21swapper/310:49:113
1246326418,23sleep10-21swapper/112:13:581
992626316,28sleep10-21swapper/108:39:251
943226319,20sleep30-21swapper/312:03:583
2810626314,35sleep028219-21cat09:38:570
2685326321,21sleep10-21swapper/107:49:261
198926316,29sleep32047-21sendmail-msp09:58:553
1981226318,28sleep30-21swapper/310:54:203
1904326317,23sleep00-21swapper/012:34:200
1904326317,23sleep00-21swapper/012:34:200
1070726321,26sleep01-21systemd08:43:570
106126316,31sleep01085-21munin-run11:38:550
97782625,11sleep10-21swapper/110:20:501
3232126222,23sleep00-21swapper/009:49:270
3208026216,32sleep332210-21latency_hist11:33:583
3085726221,20sleep10-21swapper/108:03:591
193932627,12sleep30-21swapper/309:09:243
124812627,12sleep30-21swapper/310:29:283
1070226218,26sleep310703-21cron08:43:563
547526125,20sleep30-21swapper/308:24:293
34152616,16sleep30-21swapper/310:01:583
3153226117,22sleep00-21swapper/008:04:270
1899526119,22sleep30-21swapper/307:24:283
1899526119,22sleep30-21swapper/307:24:283
1774426116,24sleep10-21swapper/112:29:211
1506026118,23sleep10-21swapper/110:39:161
1473726113,34sleep014799-21latency_hist10:38:580
1197126119,21sleep00-21swapper/010:29:170
294752606,14sleep30-21swapper/307:59:093
134126014,31sleep31544-21cmp11:38:593
540025916,26sleep05396-21apt-get10:09:100
338525916,23sleep30-21swapper/308:19:163
2124425920,16sleep00-21swapper/010:59:140
1383925914,28sleep313884-21munin-run08:53:573
688925816,25sleep16668-21apt-get10:14:001
292325815,26sleep13010-21dpkg11:43:571
237932587,10sleep00-21swapper/011:06:330
2029325818,18sleep00-21swapper/009:13:570
1863225820,20sleep10-21swapper/110:49:251
1661025817,21sleep316683-21cut10:44:143
1647325816,24sleep00-21swapper/008:59:270
1593225820,22sleep30-21swapper/312:24:183
1593225820,22sleep30-21swapper/312:24:183
1030625814,26sleep310301-21apt-get10:24:113
3172625716,25sleep331729-21diskstats09:49:143
2769625714,26sleep027621-21apt-get11:20:010
2636725614,25sleep326362-21apt-get07:49:113
2543425616,21sleep10-21swapper/107:44:251
1609325618,17sleep10-21swapper/112:24:201
1609325618,17sleep10-21swapper/112:24:201
1278525611,21sleep00-21swapper/012:14:170
1278525611,21sleep00-21swapper/012:14:170
718325515,18sleep10-21swapper/110:14:121
479025513,25sleep14785-21apt-get08:24:111
3245125514,24sleep332509-21if_eth011:34:183
231025511,15sleep00-21swapper/009:59:120
1885825515,27sleep118922-21ps07:24:261
1885825515,27sleep118922-21ps07:24:261
782225415,18sleep00-21swapper/011:58:590
782225415,18sleep00-21swapper/011:58:590
73525414,23sleep0730-21apt-get09:54:120
385525414,23sleep03850-21apt-get10:04:090
3258025415,14sleep30-21swapper/308:09:103
3125125419,17sleep10-21swapper/111:29:281
2412925413,23sleep024181-21users07:39:270
2228725417,21sleep00-21swapper/007:34:260
2228725417,21sleep00-21swapper/007:34:260
214482544,38sleep10-21swapper/109:14:311
2044625414,20sleep10-21swapper/107:29:221
1805525414,24sleep018051-21apt-get10:49:080
1744625415,23sleep117441-21apt-get09:04:091
1504625413,25sleep315053-21df_inode10:39:143
13492545,11sleep10-21swapper/109:54:291
1100225414,18sleep00-21swapper/012:09:000
926425313,28sleep0369-21snmpd12:03:150
715225313,23sleep00-21swapper/010:14:070
340225313,24sleep13388-21apt-get11:44:141
2971325313,23sleep129782-21sensors_temp11:24:311
2971325313,23sleep129782-21sensors_temp11:24:311
2557125318,16sleep30-21swapper/311:13:593
2335225314,24sleep123361-21df_inode07:39:121
525925214,22sleep00-21swapper/008:24:260
2799025211,24sleep027996-21diskstats07:54:130
787125116,19sleep17873-21apt-get08:34:081
3071425110,17sleep00-21swapper/011:29:100
2985225112,24sleep329861-21munin-run09:43:573
2985225112,24sleep329861-21munin-run09:43:573
1651325110,24sleep116508-21apt-get10:44:081
1428925115,18sleep00-21swapper/012:19:100
1428925115,18sleep00-21swapper/012:19:100
1241125112,22sleep312439-21munin-run12:13:563
1672925012,21sleep116313-21apt-get07:19:001
2763024914,18sleep00-21swapper/007:53:570
2520324912,22sleep325199-21apt-get09:29:113
2063024911,22sleep30-21swapper/309:14:173
1471824915,17sleep30-21swapper/312:19:213
32462489,19sleep00-21swapper/008:19:090
43112479,15sleep10-21swapper/110:04:221
2529824718,14sleep30-21swapper/307:44:233
2328124713,19sleep323282-21http07:39:103
932624613,20sleep19368-21systemd-run12:03:561
1833424611,18sleep00-21swapper/009:04:280
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional