You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-14 - 04:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Tue Apr 14, 2026 00:44:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
556241998177,3cyclictest551026-21kworker/u8:3+flush-259:019:36:130
556241998177,3cyclictest551026-21kworker/u8:3+flush-259:019:36:130
556247994741,4cyclictest608739-21latency_hist20:00:012
556243994338,3cyclictest252-21systemd-journal22:20:001
556241994237,4cyclictest727856-21apt-get21:55:120
556243994135,4cyclictest587442-21dpkg19:36:131
556243994135,4cyclictest587442-21dpkg19:36:121
556241994034,4cyclictest556126-21latency_hist19:10:000
556241993933,4cyclictest634904-21diskstats20:25:140
556241993932,5cyclictest868110-21ntpq00:05:210
556241993925,3cyclictest779330-21latency_hist22:45:010
556241993833,3cyclictest837024-21latency_hist23:40:010
556243993631,3cyclictest748263-21kworker/u8:0+flush-259:022:40:161
556241993628,6cyclictest737140-21ntpq22:00:230
556243993531,2cyclictest650181-21apt-get20:40:121
556243993529,4cyclictest837018-21apt-get23:40:011
556243993529,4cyclictest670516-21latency_hist21:00:011
556247993428,4cyclictest649918-21latency_hist20:40:002
556243993328,4cyclictest842866-21apt-get23:45:141
556247993127,3cyclictest509-21rs:main2
556243993127,3cyclictest869242-21apt-get00:10:111
556247993024,4cyclictest252-21systemd-journal23:54:592
556243993016,12cyclictest0-21swapper/120:30:001
556251992923,4cyclictest597550-21ntpq19:45:223
556251992923,4cyclictest597550-21ntpq19:45:213
556251992922,5cyclictest874136-21latency_hist00:15:013
556247992923,4cyclictest858552-21latency_hist00:00:012
556243992924,3cyclictest790296-21/usr/sbin/munin22:55:141
556251992822,4cyclictest509-21rs:main3
556251992821,5cyclictest644775-21latency_hist20:35:013
556251992722,4cyclictest686037-21kworker/u8:2+flush-259:021:30:263
556251992722,3cyclictest252-21systemd-journal21:07:143
556247992722,3cyclictest712132-21latency_hist21:40:002
556247992722,3cyclictest509-21rs:main2
556247992720,5cyclictest836182-21ntpq23:35:222
556251992623,2cyclictest831893-21kworker/u8:3+flush-259:023:40:183
556251992622,2cyclictest0-21swapper/323:55:003
556251992620,4cyclictest252-21systemd-journal19:36:143
556251992620,4cyclictest252-21systemd-journal19:36:143
556251992618,5cyclictest757730-21ntpq22:20:213
556251992617,6cyclictest624155-21latency_hist20:15:013
556247992621,4cyclictest821544-21latency_hist23:25:012
556243992621,4cyclictest747312-21ntpq22:10:201
556241992623,2cyclictest0-21swapper/019:55:000
556241992622,3cyclictest889127-21ntpq00:25:210
556241992621,4cyclictest853047-21gpgv23:55:010
556241992620,5cyclictest716439-21ntpq21:40:220
556251992521,3cyclictest686037-21kworker/u8:2+flush-259:021:25:173
556251992520,3cyclictest629361-21kworker/u8:1+flush-259:020:50:263
556251992519,4cyclictest252-21systemd-journal23:26:573
556251992517,5cyclictest603582-21latency_hist19:55:013
556243992521,3cyclictest758861-21apt-get22:25:131
556251992415,6cyclictest634477-21latency_hist20:25:013
556247992419,3cyclictest252-21systemd-journal19:36:032
556247992419,3cyclictest252-21systemd-journal19:36:022
556243992419,4cyclictest711205-21ntpq21:35:201
556241992418,4cyclictest509-21rs:main0
556243992318,3cyclictest252-21systemd-journal19:35:001
556241992319,3cyclictest879599-21apt-get00:20:110
556251992216,4cyclictest587702-21kworker/u8:2+flush-259:020:25:173
556251992216,4cyclictest509-21rs:main3
556247992218,3cyclictest618603-21kworker/u8:3+flush-259:020:15:182
556241992219,2cyclictest75-21kswapd022:45:020
556241992218,3cyclictest556397-21kworker/u8:0+flush-259:019:55:160
556241992215,5cyclictest804698-21ntpq23:05:230
55625199215,14cyclictest1-21systemd20:15:573
556251992116,3cyclictest879574-21/usr/sbin/munin00:20:153
55624799218,1cyclictest0-21swapper/219:45:172
55624799218,1cyclictest0-21swapper/219:45:162
556247992118,2cyclictest722482-21kworker/u8:3+flush-259:022:10:212
556247992117,3cyclictest691372-21/usr/sbin/munin21:20:152
556247992115,4cyclictest868984-21latency_hist00:10:012
556243992118,2cyclictest732328-21kworker/u8:2+events_unbound22:20:181
556243992117,3cyclictest890300-21apt-get00:30:121
556243992117,3cyclictest696982-21apt-get21:25:121
556243992116,3cyclictest696294-21apt-get21:25:001
556241992119,1cyclictest0-21swapper/020:04:590
556241992117,3cyclictest810767-21kworker/u8:1+flush-259:000:00:160
556251992013,5cyclictest843026-21diskstats23:45:163
556243992016,3cyclictest895850-21/usr/sbin/munin00:35:151
556243992016,3cyclictest748263-21kworker/u8:0+flush-259:023:27:331
556243992016,3cyclictest686037-21kworker/u8:2+flush-259:021:30:231
556251991913,4cyclictest874372-21/usr/sbin/munin00:15:143
556251991913,4cyclictest874372-21/usr/sbin/munin00:15:143
556251991912,5cyclictest810858-21gpgv23:15:013
556247991917,1cyclictest753381-21fwupd22:19:562
556247991916,2cyclictest890031-21cron00:30:002
556247991915,2cyclictest826956-21/usr/sbin/munin23:30:142
556247991912,6cyclictest0-21swapper/222:40:002
556243991917,1cyclictest634466-21cron20:25:001
556243991914,3cyclictest660194-21latency_hist20:50:011
556241991915,3cyclictest895304-21gpgv00:35:000
556241991912,5cyclictest252-21systemd-journal20:25:000
556251991813,3cyclictest737987-21kworker/u8:1+events_unbound22:05:233
556251991810,5cyclictest737987-21kworker/u8:1+flush-259:022:55:153
556247991816,1cyclictest722461-21idleruntime-cro21:50:002
556247991814,3cyclictest779354-21gpgv22:45:012
556243991813,4cyclictest624392-21/usr/sbin/munin20:15:151
556241991815,1cyclictest649925-21turbostat20:40:000
556241991813,4cyclictest670941-21diskstats21:00:140
556241991812,4cyclictest680807-21latency_hist21:10:010
556241991811,5cyclictest685076-21ntpq21:10:200
556251991715,1cyclictest874363-21kworker/u8:2+events_unbound00:25:233
556251991714,2cyclictest762874-21ntp_kernel_pll_22:25:213
556251991713,3cyclictest603843-21apt-get19:55:113
556251991712,4cyclictest686037-21kworker/u8:2+flush-259:021:35:163
556247991714,2cyclictest593249-21kworker/u8:1+events_unbound19:50:192
556247991714,2cyclictest587702-21kworker/u8:2+flush-259:020:50:182
556243991714,2cyclictest821551-21grep23:25:001
556243991714,2cyclictest671801-21kthreadcore21:00:181
556243991714,2cyclictest509-21rs:main1
556241991713,3cyclictest810767-21kworker/u8:1+flush-259:023:25:210
556241991713,3cyclictest60350irq/132-enp0s29f1:rx-020:30:230
556241991712,3cyclictest837645-21base6423:40:000
556241991710,5cyclictest572115-21latency_hist19:25:000
556251991613,2cyclictest0-21swapper/320:35:213
556251991612,3cyclictest587702-21kworker/u8:2+flush-259:020:55:163
556251991611,4cyclictest722482-21kworker/u8:3+flush-259:021:50:263
556251991611,4cyclictest588007-21turbostat19:44:553
556247991613,2cyclictest629361-21kworker/u8:1+flush-259:020:55:252
556247991610,5cyclictest762894-21ntpq22:25:212
556243991614,1cyclictest0-21swapper/122:05:001
556243991611,4cyclictest623328-21ntpq20:10:211
556241991614,1cyclictest60350irq/132-enp0s29f1:rx-023:10:160
556241991614,1cyclictest60350irq/132-enp0s29f1:rx-021:20:170
556241991613,2cyclictest60350irq/132-enp0s29f1:rx-020:48:220
556241991613,2cyclictest60350irq/132-enp0s29f1:rx-019:45:160
556241991613,2cyclictest60350irq/132-enp0s29f1:rx-019:45:160
556241991613,2cyclictest60350irq/132-enp0s29f1:rx-000:35:150
556241991611,4cyclictest743123-21latency_hist22:10:000
55625199156,7cyclictest490-21dbus-daemon19:25:003
556251991512,2cyclictest2971-21cron20:05:003
55624799151,6cyclictest634483-21munin-run20:24:592
55624399158,5cyclictest252-21systemd-journal22:55:001
556243991513,1cyclictest0-21swapper/123:40:011
556243991513,1cyclictest0-21swapper/121:50:001
556243991511,3cyclictest252-21systemd-journal21:55:571
556241991513,1cyclictest60350irq/132-enp0s29f1:rx-022:16:460
556241991513,1cyclictest60350irq/132-enp0s29f1:rx-022:10:240
556241991513,1cyclictest60350irq/132-enp0s29f1:rx-021:31:490
556241991513,1cyclictest60350irq/132-enp0s29f1:rx-020:50:170
556241991513,1cyclictest60350irq/132-enp0s29f1:rx-020:43:290
556241991513,1cyclictest60350irq/132-enp0s29f1:rx-019:40:140
556241991513,1cyclictest60350irq/132-enp0s29f1:rx-019:10:160
556241991512,2cyclictest816746-21cpuspeed_turbos23:20:140
556241991512,2cyclictest60350irq/132-enp0s29f1:rx-023:30:190
556241991512,2cyclictest60350irq/132-enp0s29f1:rx-021:45:110
556241991512,2cyclictest60350irq/132-enp0s29f1:rx-021:15:190
556241991512,2cyclictest60350irq/132-enp0s29f1:rx-019:30:220
556241991510,3cyclictest748263-21kworker/u8:0+flush-259:022:20:240
55625199147,5cyclictest857655-21ntpq23:55:203
556251991411,2cyclictest779325-21sh22:45:003
556251991410,2cyclictest0-21swapper/321:20:223
55624799148,4cyclictest790059-21latency_hist22:55:012
55624799148,4cyclictest706997-21latency_hist21:35:002
556247991412,1cyclictest0-21swapper/200:05:002
556247991410,3cyclictest874363-21kworker/u8:2+flush-259:000:17:482
556247991410,3cyclictest874363-21kworker/u8:2+flush-259:000:17:472
556247991410,3cyclictest799473-21kworker/u8:2+flush-259:023:03:322
556247991410,2cyclictest0-21swapper/219:20:012
556243991412,2cyclictest75-21kswapd023:15:021
556243991412,1cyclictest0-21swapper/100:20:011
556243991412,1cyclictest0-21swapper/100:20:001
556243991411,2cyclictest613902-21turbostat20:05:001
556243991411,2cyclictest593217-21cron19:44:591
556241991412,1cyclictest60350irq/132-enp0s29f1:rx-023:47:190
556241991412,1cyclictest60350irq/132-enp0s29f1:rx-022:55:230
556241991412,1cyclictest60350irq/132-enp0s29f1:rx-022:35:140
556241991412,1cyclictest60350irq/132-enp0s29f1:rx-021:35:150
556241991412,1cyclictest60350irq/132-enp0s29f1:rx-020:15:470
556241991412,1cyclictest60350irq/132-enp0s29f1:rx-000:15:160
556241991412,1cyclictest60350irq/132-enp0s29f1:rx-000:15:150
556241991411,2cyclictest852931-21apt-get23:55:020
556241991411,2cyclictest60350irq/132-enp0s29f1:rx-023:15:200
556241991411,2cyclictest60350irq/132-enp0s29f1:rx-000:13:100
55625199139,2cyclictest0-21swapper/323:05:143
55625199138,4cyclictest748263-21kworker/u8:0+flush-259:022:45:163
55625199138,3cyclictest629361-21kworker/u8:1+flush-259:020:45:263
55625199138,3cyclictest252-21systemd-journal23:04:553
55625199137,4cyclictest581553-21ntpq19:30:233
55625199135,5cyclictest566538-21apt-key19:20:003
55625199131,9cyclictest1-21systemd22:05:003
556251991311,1cyclictest0-21swapper/323:40:003
556251991310,2cyclictest764260-21fschecks_time22:30:143
556251991310,2cyclictest0-21swapper/322:15:143
55624799139,3cyclictest837683-21kworker/u8:2+flush-259:023:47:412
55624799139,3cyclictest810891-21cat23:15:022
556247991310,2cyclictest572095-21cron19:25:002
556243991311,1cyclictest649913-21cron20:40:001
556243991311,1cyclictest0-21swapper/123:59:591
556243991310,2cyclictest889544-21unixbench_multi00:25:241
556243991310,2cyclictest799473-21kworker/u8:2+flush-259:023:05:201
556243991310,2cyclictest768955-21sh22:35:001
556243991310,2cyclictest561808-21fschecks_count19:15:161
556243991310,1cyclictest0-21swapper/123:15:011
556241991311,1cyclictest60350irq/132-enp0s29f1:rx-023:02:020
556241991310,2cyclictest60350irq/132-enp0s29f1:rx-021:50:120
55625199128,2cyclictest691118-21cron21:20:003
55625199128,2cyclictest0-21swapper/319:25:153
55625199126,4cyclictest790063-21basename22:55:003
55625199122,1cyclictest7446802cut22:10:173
55625199120,4cyclictest900770-21latency_hist00:40:003
55625199120,3cyclictest821539-21awk23:25:003
55624799129,2cyclictest507-21in:imuxsock21:30:002
55624799129,2cyclictest0-21swapper/223:30:002
55624799129,1cyclictest0-21swapper/220:10:152
55624799126,4cyclictest252-21systemd-journal20:50:012
556247991210,1cyclictest0-21swapper/223:45:002
556247991210,1cyclictest0-21swapper/219:14:592
55624399129,2cyclictest732328-21kworker/u8:2+flush-259:022:35:271
55624399128,3cyclictest675261-21kworker/u8:0+flush-259:021:17:201
55624399128,3cyclictest509-21rs:main1
55624399126,4cyclictest727578-21cron21:55:001
556243991210,1cyclictest0-21swapper/122:10:001
556243991210,1cyclictest0-21swapper/121:45:001
556243991210,1cyclictest0-21swapper/119:10:181
55624199129,2cyclictest665713-21cpuspeed_turbos20:55:130
55624199128,3cyclictest60350irq/132-enp0s29f1:rx-022:25:120
55624199128,3cyclictest60350irq/132-enp0s29f1:rx-020:05:130
55625199118,2cyclictest811839-21irqcore23:15:173
55625199118,1cyclictest0-21swapper/321:10:183
55625199117,3cyclictest665339-21kworker/u8:3+flush-259:021:00:363
55625199111,2cyclictest8618121kthreadcore00:00:183
55625199110,3cyclictest895672-21cat00:35:013
55624799117,2cyclictest0-21swapper/221:10:222
55624799116,4cyclictest737351-21wc22:00:262
55624399118,2cyclictest800396-21cron23:05:001
55625199106,3cyclictest830859-21needreboot23:30:193
55624799108,1cyclictest0-21swapper/221:59:572
55624799106,3cyclictest401ktimers/220:05:112
5562479995,3cyclictest687818-21tr21:15:192
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional