You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-02 - 16:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Fri Jan 02, 2026 12:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2062799250,24cyclictest0-21swapper/011:31:010
20630992421,2cyclictest27174-21idleruntime-cro08:30:013
2062999240,23cyclictest0-21swapper/211:40:592
2062799240,23cyclictest22974-21apt11:40:000
20630992321,1cyclictest15255-21apt-get11:25:583
2063099230,22cyclictest4969-21grep12:10:013
20628992320,2cyclictest17565-21munin-plugin-st08:10:001
2062899230,22cyclictest10598-21/usr/sbin/munin07:55:561
20627992321,1cyclictest606-21dbus-daemon07:30:000
2062799230,23cyclictest0-21swapper/007:16:000
20630992220,1cyclictest28841-21awk09:40:013
2063099220,21cyclictest3446-21apt-get07:40:563
2063099220,21cyclictest20786-21apt-get11:35:023
20629992220,1cyclictest606-21dbus-daemon09:05:002
20629992220,1cyclictest2583-21munin-run12:05:012
20629992220,1cyclictest24788-21munin-run08:25:002
20629992220,1cyclictest0-21swapper/211:15:012
2062999220,21cyclictest9041-21apt-get10:05:022
2062999220,21cyclictest5088-21apt-get08:50:562
2062999220,21cyclictest22992-21sh07:15:012
2062999220,21cyclictest12532-21perf11:20:012
2062999220,21cyclictest0-21swapper/208:40:012
2062999220,21cyclictest0-21swapper/208:40:012
2062999220,21cyclictest0-21swapper/208:15:572
2062999220,1cyclictest15117-21awk08:05:012
20628992222,0cyclictest28542-21apt-get07:25:571
20628992221,1cyclictest0-21swapper/111:35:581
20628992220,1cyclictest23336-21apt-get07:16:001
20628992220,1cyclictest1983-21munin-run08:45:011
20628992220,1cyclictest0-21swapper/112:05:581
20628992220,1cyclictest0-21swapper/107:35:001
2062899220,21cyclictest7154-21perf08:55:011
2062899220,21cyclictest17139-21apt-get09:15:581
2062899220,21cyclictest0-21swapper/108:55:581
20627992220,1cyclictest0-21swapper/010:25:010
2062799220,21cyclictest0-21swapper/011:20:590
2062799220,21cyclictest0-21swapper/010:10:560
2062799220,1cyclictest3114-21munin-run07:40:010
2062799220,1cyclictest0-21swapper/010:55:000
20630992121,0cyclictest12501-21apt-get12:25:583
20630992121,0cyclictest0-21swapper/310:05:023
20630992120,1cyclictest5840-21apt-get07:45:573
20630992120,1cyclictest0-21swapper/309:30:593
2063099210,21cyclictest0-21swapper/307:20:593
2063099210,20cyclictest30858-21apt-get10:50:583
2063099210,20cyclictest26065-21apt-get10:40:573
2063099210,20cyclictest0-21swapper/310:30:583
2063099210,20cyclictest0-21swapper/307:10:573
2063099210,1cyclictest0-21swapper/310:20:013
2063099210,0cyclictest17362-21apt-get11:30:023
20629992120,1cyclictest913-21apt-get07:35:592
20629992120,1cyclictest14357-21grep09:10:002
20629992120,1cyclictest11590-21apt-get10:10:562
20629992120,0cyclictest31559-21apt-get09:45:562
20629992119,1cyclictest313-21systemd-journal11:00:002
2062999210,21cyclictest0-21swapper/208:30:582
2062999210,21cyclictest0-21swapper/207:40:572
2062999210,20cyclictest7688-21apt-get12:15:582
2062999210,20cyclictest21959-21apt-get09:25:582
2062999210,20cyclictest21959-21apt-get09:25:582
2062999210,20cyclictest0-21swapper/211:50:582
2062999210,20cyclictest0-21swapper/208:05:592
2062999210,0cyclictest0-21swapper/210:25:582
20628992121,0cyclictest18103-21apt11:31:011
20628992120,1cyclictest437-21cron10:55:001
20628992120,1cyclictest11001-21apt-get10:07:271
20628992120,1cyclictest0-21swapper/110:15:591
20628992120,1cyclictest0-21swapper/109:20:561
20628992120,0cyclictest14898-21apt-get12:30:581
20628992119,1cyclictest12159-21cron12:25:001
20628992119,1cyclictest1180-21sh09:50:001
2062899210,20cyclictest23006-21awk07:15:011
2062899210,20cyclictest0-21swapper/109:40:581
2062899210,20cyclictest0-21swapper/109:10:591
2062899210,20cyclictest0-21swapper/107:35:591
2062899210,0cyclictest13054-21apt-get08:01:031
2062899210,0cyclictest0-21swapper/111:10:581
2062899210,0cyclictest0-21swapper/107:45:571
20627992121,0cyclictest0-21swapper/012:01:000
20627992121,0cyclictest0-21swapper/010:25:580
20627992121,0cyclictest0-21swapper/007:40:570
20627992120,1cyclictest25102-21apt-get08:25:570
20627992119,1cyclictest553-21idleruntime-cro07:35:000
20627992119,1cyclictest313-21systemd-journal10:10:010
20627992119,1cyclictest1968-21apt-get08:45:010
2062799210,21cyclictest0-21swapper/012:30:580
2062799210,20cyclictest0-21swapper/009:40:570
2062799210,20cyclictest0-21swapper/008:50:560
2062799210,0cyclictest0-21swapper/012:35:580
20630992020,0cyclictest2692-21apt-get08:45:583
20630992020,0cyclictest25707-21apt-get11:45:593
20630992020,0cyclictest0-21swapper/311:55:593
20630992020,0cyclictest0-21swapper/310:10:563
20630992020,0cyclictest0-21swapper/309:55:573
20630992020,0cyclictest0-21swapper/309:00:583
20630992020,0cyclictest0-21swapper/307:31:003
20630992019,1cyclictest454-21apt-get12:00:593
20630992019,1cyclictest32315-21apt-get08:40:593
20630992019,1cyclictest10630-21apt-get07:55:563
20630992019,1cyclictest0-21swapper/310:56:003
20630992018,1cyclictest24777-21turbostat.cron08:25:003
2063099200,0cyclictest0-21swapper/310:20:593
20629992020,0cyclictest17890-21apt-get08:10:572
20629992020,0cyclictest0-21swapper/212:25:582
20629992020,0cyclictest0-21swapper/212:20:572
20629992020,0cyclictest0-21swapper/211:25:582
20629992020,0cyclictest0-21swapper/210:45:572
20629992020,0cyclictest0-21swapper/208:40:592
20629992020,0cyclictest0-21swapper/208:30:012
2062999200,20cyclictest0-21swapper/211:35:582
2062999200,20cyclictest0-21swapper/209:20:572
2062999200,19cyclictest0-21swapper/212:35:572
2062999200,0cyclictest0-21swapper/210:30:582
20628992020,0cyclictest0-21swapper/111:55:591
20628992020,0cyclictest0-21swapper/111:20:591
20628992020,0cyclictest0-21swapper/111:15:581
20628992020,0cyclictest0-21swapper/111:01:001
20628992020,0cyclictest0-21swapper/110:25:581
20628992020,0cyclictest0-21swapper/109:55:571
20628992019,0cyclictest0-21swapper/110:35:591
2062899200,20cyclictest0-21swapper/109:50:581
2062899200,20cyclictest0-21swapper/108:10:571
2062899200,0cyclictest0-21swapper/111:50:581
2062899200,0cyclictest0-21swapper/110:40:571
2062899200,0cyclictest0-21swapper/109:00:581
2062899200,0cyclictest0-21swapper/108:20:551
20627992020,0cyclictest0-21swapper/011:15:580
20627992020,0cyclictest0-21swapper/010:35:580
20627992020,0cyclictest0-21swapper/010:30:580
20627992020,0cyclictest0-21swapper/009:50:580
20627992020,0cyclictest0-21swapper/008:01:020
20627992020,0cyclictest0-21swapper/007:45:570
20627992020,0cyclictest0-21swapper/007:20:590
20627992019,0cyclictest0-21swapper/012:25:570
20627992019,0cyclictest0-21swapper/012:15:580
20627992019,0cyclictest0-21swapper/007:55:560
20627992018,1cyclictest17143-21taskset09:15:580
2062799200,19cyclictest32573-21dump-pmu-power12:00:010
20630991919,0cyclictest29895-21apt-get08:35:593
20630991919,0cyclictest29895-21apt-get08:35:593
20630991919,0cyclictest0-21swapper/309:45:563
20630991919,0cyclictest0-21swapper/309:10:593
20630991919,0cyclictest0-21swapper/308:20:003
20630991919,0cyclictest0-21swapper/308:01:033
20630991919,0cyclictest0-21swapper/307:16:003
20630991918,1cyclictest24029-21perf09:30:013
20630991918,1cyclictest24029-21perf09:30:013
20630991918,1cyclictest0-21swapper/308:50:563
20629991919,0cyclictest0-21swapper/211:55:592
20629991919,0cyclictest0-21swapper/211:45:592
20629991919,0cyclictest0-21swapper/210:15:592
20629991919,0cyclictest0-21swapper/208:45:582
20629991919,0cyclictest0-21swapper/207:45:572
20629991919,0cyclictest0-21swapper/207:15:592
20629991918,1cyclictest17993-21apt-get11:30:022
2062999190,0cyclictest0-21swapper/207:20:592
20628991919,0cyclictest0-21swapper/109:25:581
20628991919,0cyclictest0-21swapper/109:25:581
20628991919,0cyclictest0-21swapper/109:05:571
20628991919,0cyclictest0-21swapper/108:35:581
20628991919,0cyclictest0-21swapper/108:35:581
20628991918,0cyclictest832-21apt-get10:56:001
20628991917,1cyclictest606-21dbus-daemon07:55:011
20628991917,1cyclictest21256-21apt-get10:30:581
20627991919,0cyclictest28459-21apt-get10:45:570
20627991919,0cyclictest0-21swapper/010:56:000
20627991919,0cyclictest0-21swapper/008:05:590
20627991918,0cyclictest0-21swapper/009:05:570
20627991917,1cyclictest0-21swapper/008:50:010
2062799190,19cyclictest0-21swapper/008:55:580
20630991818,0cyclictest5295-21apt-get12:10:583
20630991818,0cyclictest0-21swapper/311:50:583
20630991818,0cyclictest0-21swapper/311:15:583
20630991818,0cyclictest0-21swapper/308:55:583
2063099180,8cyclictest0-21swapper/308:30:583
2063099180,17cyclictest10106-21apt-get12:20:573
20629991818,0cyclictest5655-21apt-get11:05:592
20629991818,0cyclictest0-21swapper/212:10:582
20629991818,0cyclictest0-21swapper/210:00:592
20629991818,0cyclictest0-21swapper/207:55:562
20628991818,0cyclictest0-21swapper/112:15:591
20628991818,0cyclictest0-21swapper/112:00:591
20628991818,0cyclictest0-21swapper/111:40:591
20628991816,1cyclictest0-21swapper/109:40:011
2062799184,13cyclictest2867-21/usr/sbin/munin12:06:050
20627991818,0cyclictest8235-21apt-get07:50:580
20627991818,0cyclictest0-21swapper/011:45:590
20627991818,0cyclictest0-21swapper/011:25:580
20627991818,0cyclictest0-21swapper/010:40:570
20627991818,0cyclictest0-21swapper/010:00:590
20627991818,0cyclictest0-21swapper/008:35:010
20627991818,0cyclictest0-21swapper/008:15:570
20630991717,0cyclictest0-21swapper/310:45:583
20630991717,0cyclictest0-21swapper/309:15:583
20630991717,0cyclictest0-21swapper/307:25:573
20629991717,0cyclictest0-21swapper/207:31:002
2062999171,14cyclictest1-21systemd09:35:012
20628991717,0cyclictest0-21swapper/111:05:581
20628991717,0cyclictest0-21swapper/108:25:571
20628991715,1cyclictest19399-21latency_hist12:40:011
20627991717,0cyclictest0-21swapper/011:05:580
20627991717,0cyclictest0-21swapper/011:01:000
20627991717,0cyclictest0-21swapper/009:35:580
20627991717,0cyclictest0-21swapper/009:30:590
20627991715,1cyclictest0-21swapper/009:55:580
20630991616,0cyclictest0-21swapper/311:10:593
20630991616,0cyclictest0-21swapper/311:01:003
20630991616,0cyclictest0-21swapper/310:25:583
20630991616,0cyclictest0-21swapper/309:50:583
20630991616,0cyclictest0-21swapper/308:06:003
20630991616,0cyclictest0-21swapper/307:50:583
20630991615,0cyclictest23313-21apt-get11:40:593
20630991614,1cyclictest12864-21apt-get11:20:593
2063099160,15cyclictest8487-21munin-run10:05:013
2063099160,15cyclictest3127-21perf07:40:013
20629991616,0cyclictest3942-21apt-get09:55:572
20629991616,0cyclictest0-21swapper/212:05:592
20629991614,1cyclictest29591-21ntp_states07:26:042
2062999160,15cyclictest19259-21latency_hist09:20:012
2062999160,15cyclictest0-21swapper/210:45:002
20628991614,1cyclictest0-21swapper/110:45:571
2062899160,12cyclictest783-21snmpd10:03:051
20627991616,0cyclictest0-21swapper/009:10:590
20627991616,0cyclictest0-21swapper/007:10:580
20627991615,0cyclictest0-21swapper/012:10:590
20627991614,1cyclictest28100-21apt-get11:50:570
20627991614,1cyclictest0-21swapper/011:14:420
20627991614,1cyclictest0-21swapper/009:21:000
2062799160,1cyclictest0-21swapper/008:25:000
2062799160,15cyclictest0-21swapper/009:45:550
20630991515,0cyclictest0-21swapper/309:05:573
20630991513,1cyclictest0-21swapper/312:36:033
20629991515,0cyclictest0-21swapper/212:30:582
20629991514,1cyclictest23652-21apt-get10:35:592
20629991513,1cyclictest30214-21ntp_states09:41:032
2062999150,14cyclictest793-21lldpd08:57:112
2062999150,14cyclictest611-21irqbalance09:51:532
20628991515,0cyclictest0-21swapper/107:40:561
20628991513,1cyclictest0-21swapper/110:20:591
20630991414,0cyclictest0-21swapper/309:40:223
2063099140,14cyclictest0-21swapper/312:15:163
2063099140,14cyclictest0-21swapper/310:36:113
2063099140,14cyclictest0-21swapper/309:20:063
2063099140,14cyclictest0-21swapper/308:10:493
2063099140,0cyclictest0-21swapper/312:30:113
2062999140,14cyclictest0-21swapper/211:21:032
2062999140,14cyclictest0-21swapper/211:00:132
2062999140,14cyclictest0-21swapper/210:50:202
2062999140,14cyclictest0-21swapper/210:20:472
2062999140,14cyclictest0-21swapper/209:35:292
2062999140,14cyclictest0-21swapper/209:10:082
2062999140,14cyclictest0-21swapper/207:50:442
20628991414,0cyclictest0-21swapper/108:15:391
2062899140,14cyclictest0-21swapper/109:30:121
2062899140,14cyclictest0-21swapper/108:45:251
2062899140,0cyclictest0-21swapper/112:25:361
2062899140,0cyclictest0-21swapper/112:10:341
2062899140,0cyclictest0-21swapper/107:20:051
20627991414,0cyclictest0-21swapper/011:40:210
20627991414,0cyclictest0-21swapper/010:15:010
20627991414,0cyclictest0-21swapper/009:00:430
20627991414,0cyclictest0-21swapper/008:36:200
20627991414,0cyclictest0-21swapper/008:36:200
20627991414,0cyclictest0-21swapper/008:10:170
2062799140,14cyclictest0-21swapper/012:20:310
2062799140,14cyclictest0-21swapper/009:25:240
2062799140,14cyclictest0-21swapper/009:25:240
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional