You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-08 - 21:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7s.osadl.org (updated Thu Jan 08, 2026 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4521532143109,28sleep10-21swapper/119:09:141
4520322141101,24sleep20-21swapper/219:07:442
4519482141102,33sleep00-21swapper/019:06:370
4518942141110,26sleep30-21swapper/319:05:573
452462992819,7cyclictest13573-21gdbus19:35:062
452462992418,5cyclictest506586-21awk21:55:012
452462992218,2cyclictest0-21swapper/221:40:012
452456992217,3cyclictest0-21swapper/100:20:001
45246699216,4cyclictest355-21systemd-journal19:57:193
452462992117,2cyclictest0-21swapper/200:14:592
45245699211,17cyclictest487547-21ntpq20:55:171
452452992117,3cyclictest13065-10wireplumber23:05:010
452452992117,1cyclictest453878-21apt-get19:15:020
452452992115,4cyclictest13065-10wireplumber22:20:000
45246699209,8cyclictest475409-21munin-run20:20:003
45246699207,10cyclictest13573-21gdbus21:40:353
452466992016,2cyclictest493070-21idleruntime-cro21:15:013
452466992015,3cyclictest521588-21smartctl22:40:133
452456992011,6cyclictest545998-21memory23:55:151
4916452190,1sleep30-21swapper/321:10:003
452466991912,5cyclictest528997-21dpkg23:05:003
45246699190,5cyclictest530751-21taskset23:08:593
45246699190,17cyclictest458596-21/usr/sbin/munin19:25:183
45246299195,12cyclictest659-21in:imuxsock19:57:182
452462991915,3cyclictest13236-21gnome-shell00:00:012
452462991912,6cyclictest478816-21/usr/sbin/munin20:30:182
452456991918,1cyclictest103-21hwrng19:11:251
452456991915,2cyclictest555250-21packagekitd00:30:331
452456991911,6cyclictest530470-21PK-Backend23:05:341
452456991910,6cyclictest645-21dbus-daemon00:25:051
452452991911,6cyclictest554466-21users00:20:200
452452991911,6cyclictest501268-21/usr/sbin/munin21:40:000
452452991911,6cyclictest469758-21meminfo20:00:170
452466991815,2cyclictest485916-21needreboot20:50:163
452466991815,2cyclictest483478-21apt-key20:45:013
452466991812,4cyclictest519433-21taskset22:34:213
45246699181,11cyclictest13236-21gnome-shell00:03:593
45246699180,16cyclictest493337-21apt-get21:15:113
45246299189,7cyclictest0-21swapper/220:45:002
45246299186,8cyclictest530858-21basename23:10:002
45246299182,14cyclictest491239-21seq21:06:542
452462991815,2cyclictest459336-21dump-pmu-power19:30:012
452462991814,3cyclictest522664-21dump-pmu-power22:45:002
452462991814,3cyclictest13548-21gmain23:20:432
452462991814,2cyclictest0-21swapper/220:00:182
452456991814,2cyclictest465942-21idleruntime-cro19:50:001
452456991813,3cyclictest0-21swapper/119:59:591
45245699181,15cyclictest524993-21ntpq22:50:161
452456991811,4cyclictest645-21dbus-daemon23:20:011
452456991811,4cyclictest542183-21cron23:45:001
45245699180,4cyclictest506250-21seq21:51:001
45245299189,4cyclictest513096-10sshd22:14:120
45245299187,9cyclictest524732-21hddtemp_smartct22:50:130
45245299181,9cyclictest533998-21munin-run23:20:000
452452991815,2cyclictest642-21cron23:35:000
452452991815,2cyclictest13548-21gmain00:30:330
45245299181,15cyclictest794-21snmpd19:53:070
452452991810,7cyclictest509111-21/usr/sbin/munin22:00:150
452466991714,2cyclictest659-21in:imuxsock19:45:003
452466991714,2cyclictest513178-21/usr/sbin/munin22:15:003
45246699171,15cyclictest794-21snmpd21:58:453
452466991711,4cyclictest795-21runrttasks00:21:593
45246699170,5cyclictest559964-21runrttasks00:37:503
45246699170,4cyclictest497687-21taskset21:28:273
45246699170,4cyclictest471410-21grep20:05:163
45246699170,16cyclictest535690-21taskset23:22:503
45246699170,15cyclictest501255-21cron21:40:013
452462991714,2cyclictest534369-21latency_hist23:20:012
45246299171,14cyclictest460638-21taskset19:31:452
45246299170,15cyclictest516935-21/usr/sbin/munin22:25:152
45246299170,15cyclictest501780-21runrttasks21:40:032
45245699178,7cyclictest485189-21awk20:50:001
45245699178,7cyclictest485189-21awk20:50:001
45245699178,6cyclictest509258-21ntpq22:00:181
452456991711,4cyclictest454379-21munin-node19:50:111
452456991710,5cyclictest498313-21seq21:30:051
45245699170,4cyclictest549422-21/usr/sbin/munin00:05:191
45245699170,4cyclictest491422-21runrttasks21:09:131
45245699170,15cyclictest459787-21/usr/sbin/munin19:30:121
45245699170,15cyclictest13236-21gnome-shell20:13:581
45245299178,6cyclictest469094-21systemctl20:00:000
45245299176,5cyclictest506962-10sh21:55:020
452452991714,2cyclictest546917-21cron00:00:010
452452991713,2cyclictest551690-21idleruntime-cro00:15:000
452452991712,4cyclictest462773-21awk19:40:010
452452991711,4cyclictest794-21snmpd20:59:580
45245299170,4cyclictest795-21runrttasks19:29:590
45245299170,4cyclictest541876-21taskset23:41:060
45245299170,15cyclictest355-21systemd-journal21:15:000
45246699169,6cyclictest0-21swapper/321:20:143
45246699169,5cyclictest552420-21needreboot00:15:163
45246699168,3cyclictest525506-10sshd22:51:133
45246699161,7cyclictest480152-21munin-run20:35:003
452466991613,2cyclictest0-21swapper/319:15:013
45246699161,13cyclictest659-21in:imuxsock21:50:103
45246699160,4cyclictest540569-21runrttasks23:39:473
45246699160,3cyclictest477239-21/usr/sbin/munin20:25:143
45246299169,5cyclictest558277-21taskset00:31:222
45246299168,6cyclictest497836-21perf-exec21:30:012
452462991613,2cyclictest659-21in:imuxsock23:55:012
452462991613,2cyclictest13248-21gdbus23:25:412
452462991612,3cyclictest466735-21/usr/sbin/munin19:50:192
45246299161,12cyclictest13236-21gnome-shell22:56:592
452462991610,4cyclictest470901-21chrt20:05:032
45246299160,15cyclictest553180-21taskset00:19:092
45246299160,14cyclictest483832-21sshd20:45:122
45246299160,14cyclictest483832-21sshd20:45:112
45245699169,5cyclictest539387-21cstates23:35:141
45245699168,6cyclictest537519-21date23:30:011
45245699167,7cyclictest13573-21gdbus23:20:341
45245699167,6cyclictest508421-21cron22:00:001
45245699161,2cyclictest497821-21apt-get21:30:011
452456991611,3cyclictest471474-21ntpq20:05:171
452456991610,4cyclictest554623-21taskset00:22:141
452456991610,4cyclictest515746-21/usr/sbin/munin22:20:201
452456991610,1cyclictest504295-21/usr/sbin/munin21:45:201
45245699160,4cyclictest481346-21taskset20:35:171
45245699160,4cyclictest355-21systemd-journal00:13:191
45245699160,15cyclictest481777-21kworker/u16:4+i91520:42:591
45245699160,14cyclictest494396-21runrttasks21:16:581
45245699160,14cyclictest13471-21gnome-software21:40:031
45245299169,5cyclictest520856-21taskset22:37:240
45245299168,5cyclictest355-21systemd-journal22:10:000
45245299167,7cyclictest478579-21awk20:30:000
45245299167,6cyclictest497838-21basename21:30:010
45245299167,6cyclictest483780-21packagekitd20:45:070
45245299167,6cyclictest483780-21packagekitd20:45:060
45245299166,5cyclictest536140-10sshd23:25:120
452452991613,2cyclictest13548-21gmain21:40:060
452452991611,3cyclictest503410-21apt-get21:45:120
452452991610,4cyclictest497821-21apt-get21:30:020
45245299160,4cyclictest472996-21/usr/sbin/munin20:10:150
45245299160,14cyclictest545203-21runrttasks23:53:230
45246699159,4cyclictest794-21snmpd19:30:053
45246699159,1cyclictest532656-21/usr/sbin/munin23:15:143
45246699158,5cyclictest484308-21cat20:45:163
45246699158,5cyclictest484308-21cat20:45:153
45246699158,5cyclictest480414-21apt-get20:35:103
45246699158,4cyclictest505117-21grep21:50:013
45246699157,5cyclictest645-21dbus-daemon00:35:003
45246699156,6cyclictest556761-21dpkg00:30:003
452466991513,1cyclictest0-21swapper/323:12:173
452466991512,2cyclictest13236-21gnome-shell19:46:583
452466991511,3cyclictest13337-21JS19:58:003
45246699151,13cyclictest13236-21gnome-shell23:29:083
45246699151,11cyclictest454620-21diskstats19:15:013
452466991510,3cyclictest521060-21cron22:40:003
452466991510,3cyclictest0-21swapper/322:10:003
45246699150,4cyclictest549276-21needreboot00:05:173
45246299159,4cyclictest795-21runrttasks00:29:382
45246299159,4cyclictest494606-21chrt21:19:372
45246299157,5cyclictest520325-21grep22:35:162
45246299154,8cyclictest13471-21gnome-software19:15:382
45246299151,9cyclictest550125-21idleruntime-cro00:10:002
45246299151,3cyclictest519498-21munin-run22:35:002
452462991512,2cyclictest504687-21chrt21:49:452
452462991512,2cyclictest13236-21gnome-shell22:03:092
452462991512,2cyclictest13236-21gnome-shell00:23:092
452462991511,3cyclictest421ktimers/222:15:122
452462991510,3cyclictest513161-21cron22:14:592
452462991510,3cyclictest0-21swapper/223:45:012
452462991510,2cyclictest0-21swapper/220:59:592
45245699159,4cyclictest543423-21taskset23:45:451
45245699158,5cyclictest458606-21smartctl19:25:191
45245699157,4cyclictest545359-21basename23:55:011
452456991512,2cyclictest681-21gdbus00:05:011
452456991512,2cyclictest559312-21head00:35:151
452456991512,1cyclictest477481-21/usr/sbin/munin20:25:151
45245699151,12cyclictest464367-21idleruntime-cro19:45:011
45245699150,13cyclictest743-21sshd21:10:581
45245699150,12cyclictest13236-21gnome-shell22:35:591
45245299158,6cyclictest459568-21/usr/sbin/munin19:30:180
45245299158,5cyclictest479359-21ld20:30:170
45245299157,5cyclictest553272-21perf00:20:000
45245299156,6cyclictest681-21gdbus19:15:000
45245299155,6cyclictest519508-21basename22:35:000
452452991513,1cyclictest490243-21/usr/sbin/munin21:05:140
452452991512,2cyclictest522435-21sshd22:42:120
452452991510,3cyclictest508418-21cron22:00:000
45245299150,13cyclictest795-21runrttasks23:12:350
45245299150,13cyclictest485669-21/usr/sbin/munin20:50:130
5381102140,1sleep30-21swapper/323:30:173
45246699145,6cyclictest542343-21date23:45:013
452466991410,3cyclictest508693-21/usr/sbin/munin22:00:133
452466991410,2cyclictest760-21mta-sts-daemon21:00:183
452466991410,2cyclictest475912-21hddtemp_smartct20:20:123
45246699140,4cyclictest499297-21taskset21:30:303
45246699140,2cyclictest517907-21cron22:30:003
45246699140,2cyclictest486983-21runrttasks20:55:043
45246699140,12cyclictest457757-21idleruntime-cro19:25:003
45246299149,4cyclictest497592-21kworker/u16:1+events_unbound21:30:012
45246299149,3cyclictest537914-21sh23:30:142
45246299148,4cyclictest480623-21/usr/sbin/munin20:35:112
45246299147,5cyclictest477652-21meminfo20:25:162
45246299146,6cyclictest485647-21df_inode20:50:132
45246299146,5cyclictest457156-21smartctlcvt19:20:172
45246299146,4cyclictest524479-10sshd22:50:112
45246299145,4cyclictest489594-21sshd21:00:572
452462991412,1cyclictest0-21swapper/219:45:162
452462991411,2cyclictest507313-21/usr/sbin/munin21:55:142
452462991411,2cyclictest454173-21latency_hist19:15:002
45246299141,11cyclictest794-21snmpd21:11:262
452462991411,1cyclictest559987-21taskset00:38:082
452462991410,2cyclictest0-21swapper/222:25:002
45246299140,2cyclictest527655-21/usr/sbin/munin23:00:162
45246299140,2cyclictest13236-21gnome-shell20:15:582
45246299140,13cyclictest659-21in:imuxsock19:40:412
45246299140,13cyclictest523139-21/usr/sbin/munin22:45:132
45246299140,13cyclictest475989-21/usr/sbin/munin20:20:132
45245699148,4cyclictest528863-21taskset23:03:371
45245699147,5cyclictest455614-21/usr/sbin/munin19:15:191
45245699147,3cyclictest478833-10awk20:30:121
45245699146,5cyclictest462404-21PK-Backend19:35:381
45245699145,6cyclictest510294-21apt-get22:05:131
45245699145,6cyclictest495492-21awk21:20:181
45245699141,9cyclictest475417-21idleruntime-cro20:19:591
45245699141,7cyclictest514766-21awk22:20:001
452456991412,1cyclictest519011-21/usr/sbin/munin22:30:191
45245699141,12cyclictest527330-21seq22:59:241
45245699140,8cyclictest512257-21memory22:10:151
45245699140,1cyclictest485418-21/usr/sbin/munin20:50:171
45245699140,13cyclictest500686-21/usr/sbin/munin21:35:191
45245699140,13cyclictest0-21swapper/123:13:431
45245699140,13cyclictest0-21swapper/122:25:141
45245299149,3cyclictest0-21swapper/020:45:010
45245299147,5cyclictest534428-21gdbus23:20:010
45245299146,6cyclictest555591-21diskstats00:25:110
45245299144,6cyclictest465944-21basename19:49:590
452452991412,1cyclictest539803-21/usr/sbin/munin23:35:170
452452991412,1cyclictest0-21swapper/020:20:580
452452991411,2cyclictest13649-21gmain19:40:480
452452991410,3cyclictest493301-21runrttasks21:15:020
45245299140,3cyclictest548781-21/usr/sbin/munin00:05:150
45245299140,1cyclictest480387-21/usr/sbin/munin20:35:150
45245299140,1cyclictest0-21swapper/023:01:000
45246699131,9cyclictest551686-21perf00:15:003
45246699131,9cyclictest13236-21gnome-shell22:55:593
45246699131,7cyclictest524254-21idleruntime-cro22:50:003
452466991310,2cyclictest544008-21munin-node23:50:103
452466991310,2cyclictest462701-21chrt19:39:233
45246699130,4cyclictest543450-21chrt23:46:073
45246699130,1cyclictest472487-21/usr/sbin/munin20:10:153
45246699130,1cyclictest0-21swapper/322:24:253
45246699130,12cyclictest513631-21df22:15:113
45246699130,11cyclictest467121-21/usr/sbin/munin19:50:223
45246299138,4cyclictest510269-21munin-node22:05:122
452462991311,1cyclictest496170-21runrttasks21:24:112
452462991311,1cyclictest13236-21gnome-shell23:46:082
452462991310,2cyclictest531565-21/usr/sbin/munin23:10:172
45246299130,12cyclictest661-21rs:main2
45245699135,5cyclictest538622-21cat23:30:211
45245699131,8cyclictest523322-21meminfo22:45:151
45245699130,1cyclictest476778-21taskset20:22:221
45245699130,12cyclictest489472-21/usr/sbin/munin21:00:221
45245699130,11cyclictest521870-21/usr/sbin/munin22:40:181
45245299139,2cyclictest0-21swapper/022:20:170
45245299138,4cyclictest13065-10wireplumber00:05:010
45245299136,5cyclictest523648-21python322:45:190
45245299135,4cyclictest542650-21sh23:45:120
45245299135,3cyclictest485208-21kworker/0:1+rcu_gp21:05:010
452452991311,1cyclictest494913-21/usr/sbin/munin21:20:180
452452991311,1cyclictest456489-21/usr/sbin/munin19:20:110
452452991310,2cyclictest559314-21needreboot00:35:150
45245299130,3cyclictest474060-21/usr/sbin/munin20:15:200
45245299130,1cyclictest0-21swapper/022:55:150
45245299130,1cyclictest0-21swapper/022:25:010
45245299130,12cyclictest471644-21/usr/sbin/munin20:05:170
45246699120,1cyclictest469608-21/usr/sbin/munin20:00:153
45246299121,8cyclictest540609-21munin-plugin-st23:40:012
45246299121,8cyclictest472744-21hddtemp_smartct20:10:142
45245699125,4cyclictest456816-21latency19:20:141
45245699121,8cyclictest469863-21ntpq20:00:181
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional