You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-08 - 20:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Mon Jun 08, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
882994838,9cyclictest37205-21kworker/u8:2+flush-259:009:00:001
885994741,4cyclictest21492-21latency_hist07:30:012
887993933,4cyclictest63361-21cat08:10:013
887993734,2cyclictest75-21kswapd007:43:043
887993528,5cyclictest42538-21latency_hist07:50:003
882993429,3cyclictest75-21kswapd007:43:031
885993328,4cyclictest335557-21systemd-journal09:19:592
878993326,5cyclictest162717-21latency_hist09:45:010
878993324,7cyclictest335557-21systemd-journal07:43:060
885993129,1cyclictest37187-21fwupd07:43:002
885993025,4cyclictest335557-21systemd-journal07:25:012
878992822,4cyclictest335557-21systemd-journal08:00:010
878992720,4cyclictest74804-21diskstats08:20:140
878992720,4cyclictest246487-21latency_hist11:05:000
887992622,3cyclictest79545-21kworker/u8:3+flush-259:008:40:173
878992621,4cyclictest225135-21gpgv10:45:010
887992521,3cyclictest220086-21kworker/u8:3+flush-259:011:00:183
887992519,4cyclictest157529-21latency_hist09:40:003
887992518,5cyclictest73472-21ntpq08:15:203
882992518,5cyclictest335557-21systemd-journal12:10:001
878992519,4cyclictest286856-21ntpq11:40:250
878992519,4cyclictest286856-21ntpq11:40:240
885992420,3cyclictest37205-21kworker/u8:2+flush-259:008:30:012
885992418,4cyclictest287752-21latency_hist11:45:002
885992418,4cyclictest287752-21latency_hist11:45:002
882992419,3cyclictest74638-21apt-get08:20:111
885992318,3cyclictest335557-21systemd-journal07:35:052
885992317,4cyclictest313565-21latency_hist12:10:012
882992317,4cyclictest339776-21diskstats12:35:141
878992320,2cyclictest267151-21cron11:25:000
878992317,4cyclictest173776-21apt-get09:55:120
878992315,5cyclictest276624-21ntpq11:30:220
887992217,4cyclictest27308-21rred07:35:023
887992216,4cyclictest219861-21latency_hist10:40:013
882992217,3cyclictest189209-21/usr/sbin/munin10:10:191
878992219,1cyclictest0-21swapper/009:05:000
885992118,2cyclictest204429-21idleruntime-cro10:25:002
878992117,3cyclictest204464-21kworker/u8:0+events_unbound10:30:180
878992116,4cyclictest27358-21apt-get07:35:110
878992114,5cyclictest335557-21systemd-journal08:34:590
885992016,2cyclictest157795-21apt-get09:40:102
88299209,10cyclictest94613-21unixbench-2d08:35:261
88299209,10cyclictest0-21swapper/107:35:011
88299207,4cyclictest335557-21systemd-journal09:52:121
88299203,8cyclictest136854-21munin-run09:20:001
88299203,4cyclictest99376-21sshd08:40:211
878992012,5cyclictest20589-21ntpq07:25:210
887991916,2cyclictest2971-21cron11:40:003
887991916,2cyclictest220086-21kworker/u8:3+flush-259:011:50:173
885991915,3cyclictest194936-21kworker/u8:2+flush-259:010:40:422
882991913,4cyclictest335557-21systemd-journal09:50:001
882991913,4cyclictest335557-21systemd-journal09:08:131
882991912,5cyclictest335557-21systemd-journal11:50:001
878991914,3cyclictest90139-21kworker/u8:0+flush-259:009:50:260
878991914,3cyclictest303462-21kworker/u8:0+events_unbound12:05:190
878991914,3cyclictest136597-21kworker/u8:3+flush-259:010:20:210
878991913,4cyclictest335557-21systemd-journal11:10:540
887991815,2cyclictest21478-21cron07:30:003
887991815,1cyclictest0-21swapper/308:54:593
887991813,4cyclictest335557-21systemd-journal09:30:003
887991813,4cyclictest335557-21systemd-journal09:29:593
88299188,2cyclictest225784-21cpuspeed_turbos10:45:131
88299186,3cyclictest334471-21apt-get12:30:111
88299186,2cyclictest0-21swapper/107:20:151
882991814,3cyclictest335557-21systemd-journal07:56:131
882991812,4cyclictest267427-21apt-get11:25:091
88299180,7cyclictest68775-21latency_hist08:15:011
878991815,2cyclictest11153-21cron07:20:000
878991812,4cyclictest52856-21kworker/u8:0+flush-259:008:00:160
878991812,4cyclictest132140-21diskstats09:15:130
887991714,2cyclictest126558-21turbostat.cron09:09:593
887991711,4cyclictest335557-21systemd-journal11:00:003
887991711,4cyclictest162718-21apt-get09:45:013
885991714,2cyclictest63196-21apt-get08:10:022
885991713,3cyclictest303462-21kworker/u8:0+flush-259:012:01:202
885991713,3cyclictest272348-21kworker/u8:0+flush-259:011:35:212
88299177,1cyclictest0-21swapper/110:25:201
88299176,1cyclictest0-21swapper/110:50:141
882991714,2cyclictest277440-21sh11:35:001
882991713,3cyclictest251859-21kworker/u8:2+flush-259:011:11:111
882991712,4cyclictest335557-21systemd-journal09:34:591
87899178,6cyclictest335557-21systemd-journal07:55:000
878991714,2cyclictest60350irq/132-enp0s29f1:rx-009:20:240
878991714,2cyclictest60350irq/132-enp0s29f1:rx-009:20:230
878991714,2cyclictest60350irq/132-enp0s29f1:rx-007:20:230
878991713,3cyclictest60350irq/132-enp0s29f1:rx-009:25:210
878991713,3cyclictest60350irq/132-enp0s29f1:rx-009:25:210
878991713,3cyclictest2971-21cron10:30:000
878991713,3cyclictest136597-21kworker/u8:3+flush-259:010:10:160
878991713,2cyclictest219858-21turbostat10:40:000
878991713,2cyclictest147889-21irqcore09:30:150
878991712,3cyclictest235967-21base6410:55:010
887991614,1cyclictest0-21swapper/312:40:003
887991612,3cyclictest47951-21/usr/sbin/munin07:55:153
887991611,3cyclictest111285-21/usr/sbin/munin08:55:153
887991610,4cyclictest329027-21latency_hist12:25:013
885991614,1cyclictest0-21swapper/208:10:012
885991613,2cyclictest0-21swapper/210:00:002
885991613,1cyclictest0-21swapper/210:55:012
88299166,2cyclictest199302-21latency_hist10:20:011
88299166,1cyclictest106011-21gltestperf08:50:161
882991610,4cyclictest324126-21apt-get12:20:131
878991614,1cyclictest60350irq/132-enp0s29f1:rx-012:10:100
878991614,1cyclictest60350irq/132-enp0s29f1:rx-011:15:180
878991614,1cyclictest60350irq/132-enp0s29f1:rx-008:05:250
878991613,2cyclictest60350irq/132-enp0s29f1:rx-008:55:140
878991613,2cyclictest60350irq/132-enp0s29f1:rx-007:45:210
878991612,2cyclictest110625-21turbostat08:55:000
887991512,2cyclictest220086-21kworker/u8:3+flush-259:011:10:213
887991512,1cyclictest0-21swapper/310:55:013
887991510,4cyclictest90139-21kworker/u8:0+flush-259:009:00:053
887991510,3cyclictest225680-21/usr/sbin/munin10:45:143
88599159,4cyclictest110630-21apt-get08:55:002
885991512,2cyclictest209585-21latency_hist10:30:002
885991511,3cyclictest220086-21kworker/u8:3+flush-259:012:15:252
88299154,3cyclictest120233-21cut09:00:161
882991512,2cyclictest314236-21irqcore12:10:151
87899159,4cyclictest335557-21systemd-journal12:02:150
87899158,5cyclictest335557-21systemd-journal11:10:000
878991514,1cyclictest60350irq/132-enp0s29f1:rx-009:10:180
878991513,1cyclictest60350irq/132-enp0s29f1:rx-010:15:140
878991513,1cyclictest60350irq/132-enp0s29f1:rx-009:05:200
878991512,2cyclictest60350irq/132-enp0s29f1:rx-012:15:120
878991512,2cyclictest60350irq/132-enp0s29f1:rx-011:54:010
878991512,2cyclictest60350irq/132-enp0s29f1:rx-008:25:200
878991512,2cyclictest60350irq/132-enp0s29f1:rx-007:10:160
878991511,2cyclictest298357-21apt-get11:55:120
878991511,2cyclictest0-21swapper/010:10:000
878991511,2cyclictest0-21swapper/008:15:010
878991511,2cyclictest0-21swapper/007:35:010
878991510,4cyclictest62268-21kworker/u8:1+events_unbound08:15:140
887991412,1cyclictest0-21swapper/307:35:003
885991411,2cyclictest336769-21tr12:30:172
885991411,2cyclictest167499-21ntp_offset09:45:222
88299148,4cyclictest199561-21apt-get10:20:101
878991412,2cyclictest60350irq/132-enp0s29f1:rx-009:48:510
878991412,2cyclictest60350irq/132-enp0s29f1:rx-008:47:290
878991412,1cyclictest60350irq/132-enp0s29f1:rx-012:25:190
878991412,1cyclictest60350irq/132-enp0s29f1:rx-012:23:160
878991412,1cyclictest60350irq/132-enp0s29f1:rx-010:55:240
878991412,1cyclictest60350irq/132-enp0s29f1:rx-008:35:260
878991411,2cyclictest60350irq/132-enp0s29f1:rx-012:35:150
878991411,2cyclictest60350irq/132-enp0s29f1:rx-011:45:410
878991411,2cyclictest282589-21munin-run11:40:000
88799139,3cyclictest90139-21kworker/u8:0+flush-259:008:45:253
88799139,3cyclictest303462-21kworker/u8:0+flush-259:012:01:053
88799139,3cyclictest182403-21kthreadcore10:00:173
88799139,2cyclictest0-21swapper/312:15:143
887991310,2cyclictest313546-21sh12:10:003
887991310,2cyclictest0-21swapper/312:25:143
887991310,2cyclictest0-21swapper/309:50:173
88599139,3cyclictest288015-21apt-get11:45:132
88599139,3cyclictest261779-21kworker/u8:1+flush-259:011:22:172
88599138,3cyclictest0-21swapper/207:50:012
88599137,4cyclictest335557-21systemd-journal07:30:112
88599137,4cyclictest225016-21apt-get10:45:012
885991310,2cyclictest214737-21kworker/u8:1+flush-259:010:55:422
885991310,2cyclictest172499-21needreboot09:50:192
885991310,2cyclictest136597-21kworker/u8:3+flush-259:009:35:232
885991310,2cyclictest111310-21apt-get08:55:122
88299139,3cyclictest162830-21gpgv09:45:001
882991310,2cyclictest27464-21cpuspeed_turbos07:35:131
882991310,2cyclictest214737-21kworker/u8:1+flush-259:011:05:001
882991310,2cyclictest178877-21kworker/u8:2+events_unbound10:05:241
882991310,2cyclictest0-21swapper/111:25:011
87899139,3cyclictest60350irq/132-enp0s29f1:rx-010:45:120
878991311,1cyclictest60350irq/132-enp0s29f1:rx-010:03:570
878991310,2cyclictest99785-21unixbench_multi08:40:250
878991310,2cyclictest60350irq/132-enp0s29f1:rx-012:30:150
88799129,2cyclictest209581-21turbostat10:34:553
88799129,2cyclictest0-21swapper/310:10:123
88799127,4cyclictest58031-21sh08:05:013
887991210,1cyclictest0-21swapper/311:40:193
887991210,1cyclictest0-21swapper/311:40:193
887991210,1cyclictest0-21swapper/311:10:003
887991210,1cyclictest0-21swapper/310:45:003
887991210,1cyclictest0-21swapper/308:35:003
887991210,1cyclictest0-21swapper/308:10:113
88599128,3cyclictest37205-21kworker/u8:2+flush-259:007:51:182
88299129,2cyclictest214269-21unixbench_singl10:30:251
88299126,4cyclictest513-21gdbus08:30:011
88299126,4cyclictest251859-21kworker/u8:2+flush-259:011:15:111
882991210,1cyclictest0-21swapper/110:45:011
878991210,1cyclictest60350irq/132-enp0s29f1:rx-011:28:080
88799119,1cyclictest0-21swapper/308:25:123
88799118,2cyclictest17650irq/131-nvme0q408:25:013
88799118,2cyclictest156342sleep307:20:253
88799118,2cyclictest0-21swapper/308:39:593
88799117,3cyclictest271398-21awk11:25:193
88799117,3cyclictest220086-21kworker/u8:3+flush-259:012:30:243
88799117,3cyclictest204464-21kworker/u8:0+flush-259:010:25:173
88799117,3cyclictest1088-21apt-get07:10:133
88799111,2cyclictest162718-21apt09:45:003
88799110,2cyclictest188977-21apt10:10:003
88599119,1cyclictest0-21swapper/210:10:162
88599119,1cyclictest0-21swapper/208:25:002
88599118,2cyclictest298425-21cpuspeed_turbos11:55:132
88599118,2cyclictest293374-21fschecks_count11:50:132
88599118,2cyclictest188543-21unixbench_singl10:05:262
88599118,2cyclictest0-21swapper/212:20:152
88599118,1cyclictest0-21swapper/208:40:202
88599117,3cyclictest401ktimers/209:05:132
88599117,3cyclictest344268-21kworker/u8:1+flush-259:012:38:202
88599116,4cyclictest37205-21kworker/u8:2+flush-259:008:35:252
88599111,8cyclictest199309-21munin-run10:20:002
88599111,8cyclictest105454-21awk08:50:002
88299119,1cyclictest183793-21cron10:05:001
88299118,2cyclictest38665-21kthreadcore07:45:171
88299116,4cyclictest214737-21kworker/u8:1+flush-259:010:37:431
88299115,4cyclictest69324-21cp08:15:011
88799101,8cyclictest47773-21cat07:55:013
88599107,2cyclictest126951-21cpuspeed_turbos09:10:132
88599107,2cyclictest120369-21needreboot09:00:182
88599101,2cyclictest246480-21awk11:05:002
88299108,1cyclictest0-21swapper/112:25:251
88299107,2cyclictest283025-21fschecks_count11:40:141
88299107,2cyclictest283025-21fschecks_count11:40:141
88299106,3cyclictest10198-21cut07:15:191
88299106,2cyclictest136597-21kworker/u8:3+flush-259:009:20:161
88299106,2cyclictest136597-21kworker/u8:3+flush-259:009:20:161
87899107,2cyclictest0-21swapper/009:35:260
8829994,3cyclictest173492-21cron09:55:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional