You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-24 - 16:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Wed Dec 24, 2025 12:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
6844992620,5cyclictest3761-21idleruntime-cro08:10:000
6844992619,6cyclictest569-21sh09:10:000
684499260,25cyclictest0-21swapper/009:55:130
6844992521,4cyclictest0-21swapper/011:35:120
6854992422,1cyclictest0-21swapper/312:25:003
685499240,23cyclictest0-21swapper/308:55:113
6844992422,1cyclictest606-21dbus-daemon08:50:010
6844992422,1cyclictest0-21swapper/011:50:010
684499240,0cyclictest27051-21apt-get12:15:140
6854992323,0cyclictest0-21swapper/311:05:133
685499230,2cyclictest23998-21apt12:10:013
685499230,0cyclictest0-21swapper/311:50:133
685499230,0cyclictest0-21swapper/311:50:133
6852992320,2cyclictest21386-21sendmail-msp07:40:002
685299231,1cyclictest6800-21munin-plugin-st12:40:012
685299230,23cyclictest0-21swapper/212:15:022
685299230,22cyclictest26371-21apt12:15:002
685299230,22cyclictest16487-21grep07:30:002
684799231,21cyclictest8636-21awk08:20:001
684799230,22cyclictest32693-21perf10:15:011
684799230,22cyclictest1570-21idleruntime-cro12:30:001
6844992323,0cyclictest9874-21apt-get11:40:140
6844992321,1cyclictest0-21swapper/010:35:000
684499230,22cyclictest32345-21perf11:20:010
684499230,22cyclictest28166-21apt-get10:05:120
6854992220,1cyclictest3765-21turbostat08:10:003
6854992220,1cyclictest25139-21perf11:05:013
6854992220,1cyclictest18869-21latency_hist07:35:003
6854992220,1cyclictest10275-21sh09:30:013
6854992220,1cyclictest0-21swapper/307:50:013
685499220,21cyclictest31273-21apt-get08:00:123
685499220,21cyclictest30557-21apt-get10:10:113
685499220,21cyclictest26461-21apt-get07:50:123
685499220,21cyclictest0-21swapper/310:30:113
685499220,21cyclictest0-21swapper/308:35:023
685499220,21cyclictest0-21swapper/308:35:023
6852992222,0cyclictest18922-21apt-get08:40:142
6852992221,1cyclictest2248-21apt-get12:30:122
6852992218,3cyclictest14086-21apt07:25:002
685299220,2cyclictest5084-21turbostat10:25:012
685299220,21cyclictest0-21swapper/210:10:112
6847992220,1cyclictest15462-21cron09:40:011
6847992220,1cyclictest0-21swapper/108:50:011
684799220,21cyclictest7142-21munin-plugin-st11:35:001
684799220,21cyclictest4045-21apt-get08:10:121
684799220,21cyclictest23016-21apt-get11:00:121
684799220,21cyclictest1642-21apt-get08:05:111
684799220,21cyclictest0-21swapper/109:10:001
684799220,1cyclictest11984-21cron11:45:011
684799220,0cyclictest0-21swapper/109:25:121
6844992220,1cyclictest607-21in:imuxsock07:20:000
6844992220,1cyclictest23798-21perf07:45:010
6844992220,1cyclictest20325-21apt10:55:010
6844992220,1cyclictest15828-21cron08:35:010
6844992220,1cyclictest0-21swapper/011:05:010
6844992220,1cyclictest0-21swapper/007:40:010
6844992219,3cyclictest10210-21apt-get10:35:130
684499220,21cyclictest967-21dump-pmu-power08:05:010
684499220,21cyclictest31865-21apt-get12:25:120
684499220,21cyclictest10287-21apt-get09:30:010
684499220,21cyclictest0-21swapper/011:20:130
684499220,21cyclictest0-21swapper/008:40:140
684499220,1cyclictest5356-21apt-get10:25:120
684499220,1cyclictest16804-21munin-run11:55:010
684499220,1cyclictest16804-21munin-run11:55:010
6854992118,2cyclictest30289-21turbostat10:10:013
685499210,21cyclictest24264-21apt-get12:10:133
685499210,21cyclictest14351-21apt-get07:25:113
685499210,21cyclictest0-21swapper/309:30:023
685499210,0cyclictest1569-21apt-get12:30:023
685499210,0cyclictest0-21swapper/308:25:113
6852992121,0cyclictest0-21swapper/212:20:142
6852992119,1cyclictest12352-21perf10:40:002
6852992119,1cyclictest12266-21apt-get11:45:122
685299210,21cyclictest0-21swapper/208:05:112
685299210,20cyclictest0-21swapper/211:30:142
685299210,20cyclictest0-21swapper/210:40:022
685299210,1cyclictest10314-21awk09:30:012
6847992121,0cyclictest19143-21apt-get07:35:111
6847992121,0cyclictest0-21swapper/112:35:111
6847992121,0cyclictest0-21swapper/112:30:131
6847992121,0cyclictest0-21swapper/110:50:111
6847992121,0cyclictest0-21swapper/109:30:021
6847992119,1cyclictest313-21systemd-journal09:20:001
6847992119,1cyclictest23077-21perf09:55:001
6847992118,2cyclictest313-21systemd-journal10:20:011
684799210,21cyclictest0-21swapper/109:20:161
684799210,20cyclictest0-21swapper/111:55:141
684799210,20cyclictest0-21swapper/110:55:131
684799210,20cyclictest0-21swapper/108:40:141
684799210,0cyclictest0-21swapper/111:20:131
684799210,0cyclictest0-21swapper/110:40:121
684799210,0cyclictest0-21swapper/109:45:141
6844992121,0cyclictest0-21swapper/012:30:020
6844992121,0cyclictest0-21swapper/009:45:140
6844992121,0cyclictest0-21swapper/009:00:120
6844992120,0cyclictest16749-21apt-get07:30:120
684499210,21cyclictest10287-21apt-get09:30:020
684499210,21cyclictest0-21swapper/010:00:130
684499210,21cyclictest0-21swapper/008:35:120
684499210,21cyclictest0-21swapper/008:35:120
684499210,20cyclictest0-21swapper/008:10:120
6854992020,0cyclictest0-21swapper/312:35:113
6854992020,0cyclictest0-21swapper/312:00:123
6854992020,0cyclictest0-21swapper/311:55:143
6854992019,0cyclictest0-21swapper/307:15:123
685499200,20cyclictest0-21swapper/307:10:123
685499200,0cyclictest25774-21apt-get10:00:133
685499200,0cyclictest13023-21apt-get10:40:123
685499200,0cyclictest0-21swapper/307:40:123
6852992020,0cyclictest8919-21apt-get08:20:112
6852992020,0cyclictest0-21swapper/210:45:142
6852992020,0cyclictest0-21swapper/208:00:122
6852992020,0cyclictest0-21swapper/207:10:122
6852992018,1cyclictest7915-21idleruntime-cro09:25:012
685299200,20cyclictest0-21swapper/209:15:132
685299200,19cyclictest0-21swapper/212:05:012
685299200,0cyclictest0-21swapper/211:05:122
685299200,0cyclictest0-21swapper/207:40:122
685299200,0cyclictest0-21swapper/207:15:122
6847992020,0cyclictest0-21swapper/112:20:141
6847992020,0cyclictest0-21swapper/111:10:131
6847992020,0cyclictest0-21swapper/107:30:121
6847992019,1cyclictest4736-21munin-run11:30:001
6847992019,1cyclictest0-21swapper/107:25:111
6847992018,1cyclictest14663-21apt-get11:50:141
6847992018,1cyclictest14663-21apt-get11:50:141
6847992018,1cyclictest14385-21awk11:50:011
684799200,20cyclictest0-21swapper/108:20:111
684499206,13cyclictest1500-21gltestperf09:10:150
6844992020,0cyclictest495-21apt-get10:15:140
6844992020,0cyclictest0-21swapper/012:20:140
6844992020,0cyclictest0-21swapper/009:50:110
6844992020,0cyclictest0-21swapper/009:35:130
6844992020,0cyclictest0-21swapper/009:20:160
6844992020,0cyclictest0-21swapper/007:50:120
6844992020,0cyclictest0-21swapper/007:25:110
684499200,20cyclictest0-21swapper/012:10:130
684499200,20cyclictest0-21swapper/011:25:120
684499200,20cyclictest0-21swapper/009:15:130
6854991919,0cyclictest0-21swapper/310:15:143
6854991919,0cyclictest0-21swapper/309:45:033
6854991919,0cyclictest0-21swapper/309:10:123
6854991919,0cyclictest0-21swapper/308:20:103
6854991919,0cyclictest0-21swapper/308:10:113
6854991919,0cyclictest0-21swapper/307:55:123
6854991918,1cyclictest26371-21apt-get12:15:023
6854991918,1cyclictest18203-21apt-get10:50:123
6852991919,0cyclictest890-21apt-get09:10:122
6852991919,0cyclictest7760-21apt-get10:30:112
6852991919,0cyclictest32619-21apt-get11:20:132
6852991919,0cyclictest26103-21apt-get08:55:122
6852991919,0cyclictest0-21swapper/212:25:132
6852991919,0cyclictest0-21swapper/211:10:132
6852991919,0cyclictest0-21swapper/211:00:112
6852991919,0cyclictest0-21swapper/209:50:202
6852991918,1cyclictest0-21swapper/208:30:112
6852991918,0cyclictest0-21swapper/210:55:132
6852991917,1cyclictest30299-21wc10:10:012
6852991917,1cyclictest0-21swapper/209:40:012
6847991919,0cyclictest15838-21apt-get08:35:021
6847991919,0cyclictest15838-21apt-get08:35:021
6847991919,0cyclictest0-21swapper/112:05:131
6847991919,0cyclictest0-21swapper/111:15:151
6847991919,0cyclictest0-21swapper/110:20:141
6847991919,0cyclictest0-21swapper/109:10:121
6847991919,0cyclictest0-21swapper/107:20:121
6847991918,1cyclictest15808-21apt-get10:45:131
6844991917,1cyclictest29924-21turbostat11:15:010
6854991818,0cyclictest3297-21apt-get09:15:133
6854991818,0cyclictest2966-21apt-get10:20:143
6854991818,0cyclictest27804-21apt-get11:10:133
6854991818,0cyclictest2602-21apt-get11:25:113
6854991818,0cyclictest20600-21apt-get10:55:133
6854991818,0cyclictest0-21swapper/311:45:013
6854991818,0cyclictest0-21swapper/311:35:113
6854991818,0cyclictest0-21swapper/309:55:133
6854991818,0cyclictest0-21swapper/308:45:133
6852991818,0cyclictest0-21swapper/208:15:452
6852991818,0cyclictest0-21swapper/208:10:122
6847991818,0cyclictest0-21swapper/109:55:131
6847991818,0cyclictest0-21swapper/109:40:131
6847991818,0cyclictest0-21swapper/109:00:131
6847991818,0cyclictest0-21swapper/108:50:101
6847991818,0cyclictest0-21swapper/108:25:121
6847991818,0cyclictest0-21swapper/107:45:111
6847991817,1cyclictest1040-21munin-run08:05:011
684799180,17cyclictest28224-21apt09:00:001
6844991818,0cyclictest0-21swapper/010:45:130
6844991818,0cyclictest0-21swapper/010:20:130
6844991818,0cyclictest0-21swapper/008:20:110
6854991717,0cyclictest0-21swapper/309:35:133
6854991717,0cyclictest0-21swapper/309:20:163
6854991717,0cyclictest0-21swapper/307:20:123
6852991717,0cyclictest0-21swapper/209:05:132
6852991717,0cyclictest0-21swapper/207:50:122
6852991716,1cyclictest24065-21apt-get07:45:122
6847991717,0cyclictest0-21swapper/110:30:111
6847991717,0cyclictest0-21swapper/110:25:121
6847991717,0cyclictest0-21swapper/107:55:111
6847991716,1cyclictest19474-21apt-get12:00:121
684799170,16cyclictest9312-21latency_hist07:15:011
6844991717,0cyclictest28855-21apt-get07:55:120
6844991717,0cyclictest0-21swapper/011:05:130
6844991715,1cyclictest7090-21apt-get07:10:110
684499170,3cyclictest26294-21munin-run07:50:010
685499164,11cyclictest261-21jbd2/nvme0n1p2-10:25:173
6854991616,0cyclictest20959-21apt-get09:50:113
6854991616,0cyclictest0-21swapper/312:25:133
6854991616,0cyclictest0-21swapper/311:20:133
6854991616,0cyclictest0-21swapper/309:05:123
6854991616,0cyclictest0-21swapper/308:40:143
6854991616,0cyclictest0-21swapper/308:30:123
685499160,0cyclictest23707-21apt-get08:50:103
6852991616,0cyclictest0-21swapper/210:05:002
6852991616,0cyclictest0-21swapper/209:40:132
6852991615,1cyclictest21315-21apt-get08:45:132
6852991615,0cyclictest0-21swapper/211:25:122
6852991614,1cyclictest0-21swapper/208:55:012
685299160,15cyclictest12053-21munin-plugin-st11:45:012
6847991616,0cyclictest0-21swapper/112:15:131
6847991616,0cyclictest0-21swapper/111:35:111
6847991614,1cyclictest26371-21apt-get12:15:001
684799160,15cyclictest21666-21apt-get07:40:121
684799160,15cyclictest0-21swapper/110:35:141
6844991616,0cyclictest17059-21apt-get11:55:130
6844991616,0cyclictest11958-21apt-get07:20:120
6844991616,0cyclictest0-21swapper/012:35:190
6844991616,0cyclictest0-21swapper/010:55:130
6844991616,0cyclictest0-21swapper/008:15:450
684499161,1cyclictest0-21swapper/008:50:130
684499160,0cyclictest0-21swapper/012:00:440
684499160,0cyclictest0-21swapper/010:42:040
6854991514,1cyclictest30201-21apt-get11:15:153
685499150,1cyclictest14368-21cron11:50:013
685299157,7cyclictest13455-21idleruntime-cro08:30:012
6852991513,1cyclictest9595-21perf11:40:002
685299150,15cyclictest0-21swapper/211:15:062
6844991515,0cyclictest0-21swapper/011:30:130
6844991514,1cyclictest0-21swapper/008:25:030
6854991414,0cyclictest0-21swapper/310:35:063
6854991414,0cyclictest0-21swapper/309:00:173
6854991413,1cyclictest15776-21apt-get09:40:133
685499140,14cyclictest0-21swapper/311:30:553
685499140,0cyclictest20446-21gzip07:35:183
685499140,0cyclictest0-21swapper/310:45:563
685499140,0cyclictest0-21swapper/308:15:023
6852991414,0cyclictest0-21swapper/209:45:022
6852991414,0cyclictest0-21swapper/209:00:132
6852991414,0cyclictest0-21swapper/208:35:022
6852991414,0cyclictest0-21swapper/208:35:022
685299140,14cyclictest0-21swapper/211:50:532
685299140,14cyclictest0-21swapper/211:50:532
685299140,14cyclictest0-21swapper/210:18:142
685299140,14cyclictest0-21swapper/209:31:032
685299140,0cyclictest0-21swapper/212:05:032
685299140,0cyclictest0-21swapper/211:55:092
685299140,0cyclictest0-21swapper/209:55:412
6847991414,0cyclictest0-21swapper/111:06:561
684799140,14cyclictest0-21swapper/107:15:551
684799140,0cyclictest0-21swapper/110:00:451
6844991414,0cyclictest0-21swapper/012:05:350
6844991414,0cyclictest0-21swapper/008:56:350
684499140,14cyclictest0-21swapper/009:40:560
684499140,0cyclictest0-21swapper/010:10:060
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional