You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-21 - 22:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5s.osadl.org (updated Sun Dec 21, 2025 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
225199260,2cyclictest28752-21idleruntime-cro09:10:011
2257992422,1cyclictest0-21swapper/307:39:563
2255992423,0cyclictest0-21swapper/211:04:572
2257992323,0cyclictest0-21swapper/311:04:573
2255992322,1cyclictest16276-21apt-get12:04:572
2255992322,1cyclictest0-21swapper/207:49:572
2255992321,1cyclictest17071-21cron07:40:012
225599230,0cyclictest26606-21apt-get11:19:582
2251992321,1cyclictest30414-21apt-get10:20:021
2250992321,1cyclictest0-21swapper/012:35:000
2250992321,1cyclictest0-21swapper/010:10:000
225099230,22cyclictest5194-21perf10:35:010
225099230,22cyclictest26887-21latency_hist08:00:000
225099230,1cyclictest15711-21apt-get08:44:570
2257992222,0cyclictest0-21swapper/312:04:573
2257992220,1cyclictest0-21swapper/307:15:013
2257992219,2cyclictest8075-21awk10:40:013
225799220,21cyclictest23613-21turbostat09:00:013
225799220,21cyclictest16543-21perf08:45:003
225799220,21cyclictest13859-21apt-get11:59:573
225799220,21cyclictest0-21swapper/312:24:583
225799220,21cyclictest0-21swapper/310:14:583
225799220,21cyclictest0-21swapper/309:34:573
225799220,21cyclictest0-21swapper/307:44:563
225799220,1cyclictest19756-21apt-get09:59:593
2255992220,1cyclictest4748-21munin-run08:20:012
225599220,21cyclictest26959-21apt-get10:14:582
225599220,21cyclictest16549-21awk08:45:002
225599220,21cyclictest0-21swapper/210:10:002
225599220,21cyclictest0-21swapper/208:05:012
225599220,1cyclictest0-21swapper/207:50:022
2251992212,9cyclictest0-21swapper/112:04:571
225199220,21cyclictest21064-21apt-get12:14:581
225199220,21cyclictest14699-21perf12:00:011
225199220,21cyclictest11148-21apt-get07:29:581
225199220,21cyclictest0-21swapper/111:19:591
225199220,21cyclictest0-21swapper/110:44:571
225199220,21cyclictest0-21swapper/108:05:021
225199220,1cyclictest0-21swapper/107:40:011
225199220,0cyclictest0-21swapper/107:59:561
2250992220,1cyclictest622-21gdbus07:20:010
2250992220,1cyclictest31293-21apt-get08:09:540
2250992220,1cyclictest21430-21apt08:55:010
2250992220,1cyclictest0-21swapper/007:39:560
225099220,21cyclictest0-21swapper/010:14:580
225099220,1cyclictest606-21dbus-daemon07:25:010
225099220,1cyclictest27266-21turbostat.cron11:20:010
225099220,1cyclictest25310-21apt09:04:570
2257992120,0cyclictest0-21swapper/310:34:593
2257992119,1cyclictest0-21swapper/312:19:583
225799210,21cyclictest1272-21apt-get08:14:573
225799210,20cyclictest9422-21apt-get10:44:573
225799210,20cyclictest677-21apt-get12:39:583
225799210,20cyclictest0-21swapper/308:34:573
225799210,1cyclictest26923-21awk08:00:003
225799210,0cyclictest29279-21apt-get08:05:013
2255992121,0cyclictest0-21swapper/209:44:582
2255992120,1cyclictest3863-21apt-get11:39:582
2255992120,0cyclictest21813-21apt-get11:09:572
2255992119,1cyclictest9390-21/usr/sbin/munin10:45:012
2255992119,1cyclictest14682-21plymouth12:00:012
225599210,20cyclictest0-21swapper/210:49:582
225599210,20cyclictest0-21swapper/210:19:552
225599210,1cyclictest26910-21perf08:00:002
225599210,0cyclictest30499-21apt-get09:14:582
2251992121,0cyclictest0-21swapper/107:44:561
2251992120,0cyclictest0-21swapper/109:19:571
2251992119,1cyclictest606-21dbus-daemon11:00:001
2251992119,1cyclictest0-21swapper/111:40:021
225199210,20cyclictest0-21swapper/112:09:571
225199210,0cyclictest0-21swapper/112:24:581
225199210,0cyclictest0-21swapper/111:39:581
225199210,0cyclictest0-21swapper/107:14:581
2250992120,1cyclictest11820-21apt-get10:49:570
2250992119,1cyclictest29349-21apt-get10:19:550
2250992119,1cyclictest25877-21apt-get12:24:580
2250992119,1cyclictest0-21swapper/012:00:010
2250992119,1cyclictest0-21swapper/009:54:580
225099210,21cyclictest0-21swapper/007:49:560
225099210,20cyclictest0-21swapper/012:14:570
225099210,0cyclictest12571-21apt-get09:44:580
2257992020,0cyclictest6106-21apt-get08:24:563
2257992020,0cyclictest28272-21apt-get12:30:003
2257992020,0cyclictest10154-21apt-get09:40:003
2257992020,0cyclictest0-21swapper/311:09:573
2257992020,0cyclictest0-21swapper/309:29:583
2257992020,0cyclictest0-21swapper/309:09:563
2257992020,0cyclictest0-21swapper/308:29:573
2257992019,0cyclictest489-21apt-get09:19:563
2257992018,1cyclictest606-21dbus-daemon08:40:003
2257992018,1cyclictest4788-21hddtemp_smartct11:40:013
2257992018,1cyclictest0-21swapper/307:55:003
225799200,20cyclictest0-21swapper/310:54:553
225799200,20cyclictest0-21swapper/310:09:583
225799200,20cyclictest0-21swapper/309:04:573
225799200,0cyclictest0-21swapper/310:49:583
225799200,0cyclictest0-21swapper/310:19:553
2255992020,0cyclictest0-21swapper/212:30:002
2255992020,0cyclictest0-21swapper/212:24:582
2255992020,0cyclictest0-21swapper/210:34:592
2255992020,0cyclictest0-21swapper/209:29:582
2255992019,1cyclictest0-21swapper/212:19:582
2255992018,1cyclictest8081-21lockfile-create10:40:012
2255992018,1cyclictest2182-21cron11:35:002
2255992018,1cyclictest14124-21latency_hist08:40:002
225599200,20cyclictest0-21swapper/212:39:582
225599200,20cyclictest0-21swapper/208:14:572
225599200,0cyclictest8753-21apt-get07:24:572
225599200,0cyclictest0-21swapper/209:59:592
225599200,0cyclictest0-21swapper/209:09:562
225599200,0cyclictest0-21swapper/207:14:582
2251992020,0cyclictest2967-21apt-get09:24:571
2251992020,0cyclictest0-21swapper/110:09:581
2251992020,0cyclictest0-21swapper/109:59:591
2251992020,0cyclictest0-21swapper/109:34:561
2251992020,0cyclictest0-21swapper/109:10:031
2251992020,0cyclictest0-21swapper/108:49:591
2251992020,0cyclictest0-21swapper/108:14:571
225199200,0cyclictest0-21swapper/112:34:581
2250992020,0cyclictest18456-21apt-get07:44:550
2250992020,0cyclictest0-21swapper/011:39:580
2250992020,0cyclictest0-21swapper/010:29:570
2250992020,0cyclictest0-21swapper/008:24:570
2250992020,0cyclictest0-21swapper/008:19:560
2250992018,1cyclictest19025-21apt-get11:04:570
2250992018,1cyclictest0-21swapper/007:50:020
2250992017,2cyclictest13260-21/usr/sbin/munin08:40:000
225099200,20cyclictest0-21swapper/007:14:580
225099200,19cyclictest9220-21cut11:49:580
225099200,19cyclictest0-21swapper/012:04:570
225099200,0cyclictest0-21swapper/010:39:560
225099200,0cyclictest0-21swapper/010:04:570
225099200,0cyclictest0-21swapper/008:14:570
2257991919,0cyclictest30668-21apt-get12:34:583
2257991919,0cyclictest2208-21apt-get10:29:563
2257991919,0cyclictest21064-21apt-get12:14:573
2257991919,0cyclictest0-21swapper/308:04:573
2257991918,1cyclictest0-21swapper/311:35:003
2257991918,0cyclictest0-21swapper/311:14:583
2255991919,0cyclictest0-21swapper/212:34:582
2255991919,0cyclictest0-21swapper/212:14:572
2255991919,0cyclictest0-21swapper/209:40:002
2255991919,0cyclictest0-21swapper/209:19:562
2255991919,0cyclictest0-21swapper/208:29:572
2255991919,0cyclictest0-21swapper/208:24:562
2255991918,0cyclictest0-21swapper/208:54:562
2255991917,1cyclictest6675-21apt-get11:44:582
2255991917,1cyclictest29019-21apt-get11:24:572
2255991916,2cyclictest17224-21perf11:00:002
225599190,19cyclictest0-21swapper/209:04:572
2251991919,0cyclictest0-21swapper/111:50:011
2251991919,0cyclictest0-21swapper/111:05:021
2251991919,0cyclictest0-21swapper/111:04:571
2251991919,0cyclictest0-21swapper/109:44:581
2251991918,1cyclictest23641-21apt-get07:54:551
2251991918,0cyclictest0-21swapper/112:39:581
2250991919,0cyclictest0-21swapper/011:54:570
2250991919,0cyclictest0-21swapper/008:30:010
2250991917,1cyclictest28754-21awk09:10:010
2257991818,0cyclictest22169-21apt-get10:04:573
2257991818,0cyclictest20851-21apt-get07:49:563
2257991818,0cyclictest0-21swapper/311:54:563
2257991818,0cyclictest0-21swapper/311:19:593
2257991818,0cyclictest0-21swapper/308:54:563
2257991817,0cyclictest0-21swapper/310:24:583
2257991817,0cyclictest0-21swapper/309:14:583
225799180,17cyclictest0-21swapper/309:44:593
2255991818,0cyclictest0-21swapper/211:14:582
2255991818,0cyclictest0-21swapper/210:29:562
2255991818,0cyclictest0-21swapper/210:04:572
2255991818,0cyclictest0-21swapper/208:04:572
2255991817,0cyclictest7758-21apt-get09:34:572
2255991816,1cyclictest31465-21apt-get11:29:562
2251991818,0cyclictest1447-21apt-get11:34:571
2251991818,0cyclictest14215-21apt-get10:54:561
2251991818,0cyclictest0-21swapper/112:30:001
2251991818,0cyclictest0-21swapper/108:39:571
2251991818,0cyclictest0-21swapper/107:19:561
2251991817,1cyclictest25311-21apt-get09:04:571
2251991816,1cyclictest11828-21latency_hist08:35:001
2251991815,2cyclictest21728-21perf07:50:001
2250991818,0cyclictest23460-21apt-get12:19:580
2250991818,0cyclictest0-21swapper/011:24:570
2250991818,0cyclictest0-21swapper/009:40:000
2250991818,0cyclictest0-21swapper/009:19:570
2250991818,0cyclictest0-21swapper/007:29:590
2250991817,1cyclictest0-21swapper/010:59:580
2250991816,1cyclictest0-21swapper/009:49:580
2250991816,1cyclictest0-21swapper/007:35:010
225099180,17cyclictest19815-21apt-get11:05:020
225099180,17cyclictest10202-21munin-run10:45:010
2257991717,0cyclictest0-21swapper/311:44:583
2257991717,0cyclictest0-21swapper/311:29:573
2257991717,0cyclictest0-21swapper/311:24:573
2257991716,1cyclictest17257-21lockfile-create11:00:003
2257991715,1cyclictest11790-21hddtemp_smartct07:30:013
2257991715,1cyclictest0-21swapper/309:55:013
2257991715,1cyclictest0-21swapper/307:20:013
2255991717,0cyclictest0-21swapper/207:44:552
2255991715,1cyclictest7349-21munin-run07:20:012
2255991715,1cyclictest14964-21apt-get09:49:582
2255991715,1cyclictest11827-21munin-run07:30:012
2251991717,0cyclictest8501-21apt-get08:29:571
2251991717,0cyclictest5361-21apt-get09:29:581
2251991717,0cyclictest0-21swapper/110:29:561
2251991717,0cyclictest0-21swapper/108:44:571
2251991717,0cyclictest0-21swapper/107:24:561
2251991716,1cyclictest0-21swapper/111:24:571
2251991716,1cyclictest0-21swapper/108:54:561
2251991715,1cyclictest30414-21apt-get10:20:001
2250991717,0cyclictest0-21swapper/010:54:560
2250991717,0cyclictest0-21swapper/009:34:570
2250991717,0cyclictest0-21swapper/009:24:570
2250991716,1cyclictest32221-21apt-get10:24:580
225099170,16cyclictest0-21swapper/012:30:000
2257991616,0cyclictest18668-21apt-get12:09:573
2257991616,0cyclictest0-21swapper/309:49:583
2255991616,0cyclictest0-21swapper/210:24:582
2255991615,0cyclictest0-21swapper/208:49:592
2255991614,1cyclictest606-21dbus-daemon09:55:012
225599160,16cyclictest0-21swapper/208:30:022
2251991616,0cyclictest6106-21apt-get08:24:571
2251991616,0cyclictest0-21swapper/109:39:591
2251991616,0cyclictest0-21swapper/107:34:571
225199160,15cyclictest0-21swapper/108:05:011
225199160,11cyclictest11466-21apt-get11:54:561
2250991616,0cyclictest0-21swapper/009:29:580
2257991515,0cyclictest0-21swapper/308:49:593
2257991515,0cyclictest0-21swapper/308:19:563
2255991515,0cyclictest0-21swapper/212:09:572
2251991515,0cyclictest0-21swapper/110:49:571
2251991514,1cyclictest0-21swapper/110:39:561
2251991514,0cyclictest0-21swapper/111:29:561
225199150,14cyclictest0-21swapper/109:54:571
225099150,11cyclictest1824-21sendmail-mta11:25:280
225799140,14cyclictest0-21swapper/311:45:253
225799140,14cyclictest0-21swapper/309:21:193
225799140,14cyclictest0-21swapper/307:30:453
225799140,0cyclictest0-21swapper/307:22:323
225599140,14cyclictest0-21swapper/211:45:252
225599140,14cyclictest0-21swapper/209:21:192
225599140,0cyclictest0-21swapper/210:50:052
225599140,0cyclictest0-21swapper/208:55:532
225599140,0cyclictest0-21swapper/207:30:502
2251991414,0cyclictest0-21swapper/110:30:351
2251991414,0cyclictest0-21swapper/110:00:331
2251991414,0cyclictest0-21swapper/108:15:091
225199140,14cyclictest0-21swapper/111:10:091
225199140,14cyclictest0-21swapper/110:10:241
225199140,14cyclictest0-21swapper/109:45:201
225199140,0cyclictest0-21swapper/112:16:051
2250991414,0cyclictest0-21swapper/011:40:170
2250991414,0cyclictest0-21swapper/011:10:260
2250991414,0cyclictest0-21swapper/008:34:070
225099140,14cyclictest0-21swapper/012:05:420
225099140,14cyclictest0-21swapper/008:01:400
225099140,0cyclictest0-21swapper/012:35:290
225099140,0cyclictest0-21swapper/011:30:140
225099140,0cyclictest0-21swapper/009:55:170
225099140,0cyclictest0-21swapper/008:55:020
225099140,0cyclictest0-21swapper/008:45:490
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional