You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-24 - 19:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Sun May 24, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2357803994135,4cyclictest2634697-21latency_hist11:35:012
2357799994033,5cyclictest2624368-21latency_hist11:25:011
2357805993933,4cyclictest2368017-21latency_hist07:20:003
2357795993834,3cyclictest2567206-21apt-get10:30:120
2357805993731,4cyclictest2530804-21latency_hist09:55:003
2357803993732,3cyclictest2577362-21latency_hist10:40:012
2357803993731,4cyclictest2671330-21latency_hist12:10:002
2357795993428,4cyclictest2629541-21latency_hist11:30:010
2357803993326,6cyclictest2690929-21kworker/u8:0+flush-259:012:30:002
2357795993227,4cyclictest2598371-21apt-get11:00:130
2357803993125,4cyclictest2404923-40mandb07:54:172
2357803993026,2cyclictest2315374-21kworker/u8:3+flush-259:007:15:162
2357795993026,3cyclictest2598125-21kworker/u8:0+flush-259:011:55:250
2357795993025,3cyclictest2389276-21kworker/u8:4+flush-259:008:00:010
2357795993025,3cyclictest2389276-21kworker/u8:4+flush-259:008:00:000
2357799992925,3cyclictest509-21rs:main1
2357799992924,4cyclictest335557-21systemd-journal08:53:161
2357799992923,4cyclictest2666162-21latency_hist12:05:001
2357795992923,4cyclictest2619179-21latency_hist11:20:000
235779599290,27cyclictest1-21systemd09:59:160
2357799992824,3cyclictest2587966-21kworker/u8:2+flush-259:011:15:171
2357799992824,3cyclictest2414810-21kworker/u8:1+flush-259:008:15:181
2357805992724,2cyclictest2645703-21kworker/u8:3+flush-259:012:25:003
2357805992722,3cyclictest2468505-21/usr/sbin/munin08:55:163
2357803992723,3cyclictest2494397-21/usr/sbin/munin09:20:162
2357803992721,4cyclictest2414810-21kworker/u8:1+flush-259:008:05:172
2357803992721,4cyclictest2414810-21kworker/u8:1+flush-259:008:05:162
2357803992721,4cyclictest2410340-21cat08:00:012
2357803992721,4cyclictest2410340-21cat08:00:012
2357799992724,2cyclictest2357766-21kworker/u8:1+flush-259:007:40:171
2357795992724,2cyclictest2541414-21kworker/u8:0+flush-259:010:15:240
2357805992620,4cyclictest335557-21systemd-journal11:05:003
2357803992519,4cyclictest335557-21systemd-journal08:13:162
2357799992522,2cyclictest2520506-21kworker/u8:1+flush-259:009:50:001
2357795992520,3cyclictest2394491-21/usr/sbin/munin07:45:130
2357805992420,3cyclictest2315374-21kworker/u8:3+flush-259:008:05:263
2357805992420,3cyclictest2315374-21kworker/u8:3+flush-259:008:05:263
2357805992419,4cyclictest2613613-21apt-get11:15:003
2357803992418,4cyclictest2650666-21latency_hist11:50:012
2357799992420,3cyclictest2442640-21apt-get08:30:091
2357799992420,3cyclictest2431371-21kworker/u8:2+flush-259:008:22:471
2357795992418,4cyclictest2436335-21ntpq08:20:210
2357795992417,5cyclictest2525650-21latency_hist09:50:000
2357805992319,3cyclictest2577386-21kworker/u8:0+flush-259:010:40:243
2357805992318,4cyclictest335557-21systemd-journal08:32:163
2357795992319,3cyclictest2608661-21kworker/u8:1+flush-259:011:25:000
2357795992319,3cyclictest2567167-21kworker/u8:4+flush-259:010:45:170
2357795992319,3cyclictest2414810-21kworker/u8:1+flush-259:009:10:240
2357795992319,3cyclictest2315374-21kworker/u8:3+flush-259:007:15:230
2357795992317,4cyclictest2613613-21apt-get11:15:010
2357805992218,3cyclictest2598125-21kworker/u8:0+flush-259:011:40:243
2357805992218,3cyclictest2431371-21kworker/u8:2+flush-259:008:25:253
2357805992218,3cyclictest2315374-21kworker/u8:3+flush-259:008:10:213
2357803992218,3cyclictest335557-21systemd-journal07:24:282
2357803992217,4cyclictest335557-21systemd-journal10:46:172
2357803992217,4cyclictest2489001-21kworker/u8:3+flush-259:009:45:152
2357799992218,3cyclictest2629557-21kworker/u8:2+flush-259:012:30:161
2357795992215,5cyclictest2377424-21ntpq07:25:210
2357805992117,3cyclictest2598125-21kworker/u8:0+events_unbound11:35:163
2357805992117,3cyclictest2378548-21kworker/u8:0+flush-259:009:15:173
2357805992117,3cyclictest2357766-21kworker/u8:1+flush-259:007:35:253
2357805992115,4cyclictest2598107-21latency_hist11:00:003
2357803992115,4cyclictest2540326-21ntpq10:00:212
2357799992117,3cyclictest2452829-21kworker/u8:2+flush-259:008:45:211
2357799992117,3cyclictest2442609-21kworker/u8:4+flush-259:008:40:001
2357799992117,3cyclictest2414810-21kworker/u8:1+flush-259:009:10:011
2357799992117,3cyclictest2315374-21kworker/u8:3+flush-259:007:25:251
2357795992116,4cyclictest335557-21systemd-journal11:36:170
2357805992017,2cyclictest2499375-21kworker/u8:2+events_unbound09:25:003
2357805992015,4cyclictest2645703-21kworker/u8:3+flush-259:012:00:163
2357805992014,4cyclictest335557-21systemd-journal10:19:593
2357803992014,4cyclictest2362898-21latency_hist07:15:012
2357799992017,2cyclictest2378548-21kworker/u8:0+flush-259:007:45:261
2357799992015,4cyclictest2494155-21latency_hist09:20:001
2357799992015,3cyclictest2660998-21awk12:00:011
2357805991915,3cyclictest335557-21systemd-journal08:49:163
2357805991915,3cyclictest2315374-21kworker/u8:3+flush-259:007:20:223
2357803991915,3cyclictest2357766-21kworker/u8:1+flush-259:007:43:462
2357795991915,3cyclictest2541414-21kworker/u8:0+flush-259:010:20:240
2357805991812,4cyclictest2432253-21cat08:20:013
2357805991812,4cyclictest2383486-21gpgv07:35:003
2357803991815,2cyclictest2414810-21kworker/u8:1+flush-259:008:20:012
2357803991814,3cyclictest335557-21systemd-journal11:15:032
2357803991811,6cyclictest2598109-21latency_hist11:00:002
2357799991815,2cyclictest2613732-21gpgv11:15:011
2357799991814,3cyclictest335557-21systemd-journal11:41:161
2357799991814,3cyclictest335557-21systemd-journal09:05:001
2357799991814,3cyclictest2603556-21apt-get11:05:121
2357799991814,3cyclictest2489001-21kworker/u8:3+flush-259:010:00:161
2357799991813,4cyclictest2520477-21latency_hist09:44:591
2357795991814,3cyclictest2645703-21kworker/u8:3+flush-259:012:20:210
2357795991814,3cyclictest2499454-21gpgv09:25:010
2357795991814,3cyclictest2489001-21kworker/u8:3+flush-259:010:10:210
2357795991812,4cyclictest2482959-21ntpq09:05:210
2357795991812,4cyclictest2478642-21latency_hist09:05:000
2357805991714,2cyclictest2478646-21munin-run09:05:013
2357805991713,3cyclictest2598125-21kworker/u8:0+flush-259:011:55:213
2357805991713,3cyclictest2541414-21kworker/u8:0+flush-259:010:20:163
2357805991713,3cyclictest2357766-21kworker/u8:1+flush-259:007:44:593
2357803991714,2cyclictest2468505-21/usr/sbin/munin08:55:142
2357803991712,4cyclictest2613637-21http11:15:012
2357799991715,1cyclictest2455363-21kthreadcore08:40:181
2357799991715,1cyclictest0-21swapper/108:00:011
2357799991715,1cyclictest0-21swapper/108:00:001
2357799991712,3cyclictest2489001-21kworker/u8:3+flush-259:011:00:181
2357799991711,4cyclictest335557-21systemd-journal09:11:171
2357795991715,1cyclictest0-21swapper/007:45:000
2357795991713,3cyclictest1-21systemd08:55:190
235780599169,5cyclictest2697176-21latency_hist12:35:003
2357803991614,1cyclictest2592957-21munin-plugin-st10:55:002
2357803991614,1cyclictest2452804-21idleruntime-cro08:40:002
2357803991613,2cyclictest2414810-21kworker/u8:1+flush-259:009:00:252
2357803991613,2cyclictest0-21swapper/209:40:012
2357803991612,3cyclictest2510140-21kworker/u8:4+flush-259:009:42:472
2357799991613,2cyclictest2520506-21kworker/u8:1+flush-259:010:05:161
2357799991612,3cyclictest2489001-21kworker/u8:3+flush-259:010:55:261
2357799991612,3cyclictest2414810-21kworker/u8:1+flush-259:008:56:471
2357795991614,1cyclictest60350irq/132-enp0s29f1:rx-008:48:250
2357795991613,2cyclictest60350irq/132-enp0s29f1:rx-012:10:110
2357795991613,2cyclictest60350irq/132-enp0s29f1:rx-011:50:110
2357795991613,2cyclictest60350irq/132-enp0s29f1:rx-010:50:220
2357795991613,2cyclictest60350irq/132-enp0s29f1:rx-010:35:140
2357795991612,3cyclictest2666407-21/usr/sbin/munin12:05:140
2357795991610,5cyclictest2499888-21cp09:25:010
235780599159,4cyclictest1-21systemd07:26:163
2357805991513,1cyclictest0-21swapper/309:40:013
2357805991511,3cyclictest2629557-21kworker/u8:2+flush-259:012:25:273
2357805991510,3cyclictest335557-21systemd-journal08:04:363
235780399159,4cyclictest2389050-21latency_hist07:40:002
2357803991512,2cyclictest2439770-21kthreadcore08:25:192
2357803991511,3cyclictest2414810-21kworker/u8:1+flush-259:009:05:242
235779999159,4cyclictest2357717-21latency_hist07:10:011
2357799991513,1cyclictest0-21swapper/112:10:161
2357799991512,2cyclictest2384147-21apt-get07:35:111
2357799991511,3cyclictest2697432-21apt-get12:35:101
2357799991511,3cyclictest2651300-21kworker/u8:1+flush-259:012:22:471
2357799991511,3cyclictest2368281-21apt-get07:20:111
2357799991510,4cyclictest335557-21systemd-journal09:35:011
2357799991510,4cyclictest2645712-21/usr/sbin/munin11:45:141
235779599159,1cyclictest23589312cut07:10:230
2357795991513,1cyclictest60350irq/132-enp0s29f1:rx-008:01:510
2357795991512,2cyclictest60350irq/132-enp0s29f1:rx-012:01:210
2357795991512,2cyclictest60350irq/132-enp0s29f1:rx-009:30:120
2357795991512,2cyclictest60350irq/132-enp0s29f1:rx-007:50:270
2357795991511,3cyclictest2525922-21apt-get09:50:110
2357795991511,2cyclictest60350irq/132-enp0s29f1:rx-010:55:160
235780599149,4cyclictest2399389-21apt-get07:50:003
2357805991411,2cyclictest0-21swapper/312:10:003
2357805991410,3cyclictest2463372-21apt-get08:50:113
235780399149,3cyclictest335557-21systemd-journal09:30:002
2357803991411,2cyclictest2457548-21unixbench_singl08:40:252
2357803991411,2cyclictest2378548-21kworker/u8:0+flush-259:007:45:252
235779999149,4cyclictest2399874-21gpgv07:50:001
235779999149,3cyclictest335557-21systemd-journal08:00:151
2357799991412,1cyclictest2531493-21irqcore09:55:171
2357799991411,1cyclictest0-21swapper/108:10:001
2357799991411,1cyclictest0-21swapper/108:09:591
2357799991410,3cyclictest2489001-21kworker/u8:3+flush-259:009:25:161
2357795991413,1cyclictest60350irq/132-enp0s29f1:rx-011:45:130
2357795991413,1cyclictest60350irq/132-enp0s29f1:rx-010:40:190
2357795991412,2cyclictest60350irq/132-enp0s29f1:rx-010:05:100
2357795991412,2cyclictest60350irq/132-enp0s29f1:rx-008:40:510
2357795991412,2cyclictest60350irq/132-enp0s29f1:rx-008:29:210
2357795991412,1cyclictest60350irq/132-enp0s29f1:rx-012:25:210
2357795991412,1cyclictest60350irq/132-enp0s29f1:rx-011:05:170
2357795991412,1cyclictest60350irq/132-enp0s29f1:rx-009:40:150
2357795991412,1cyclictest60350irq/132-enp0s29f1:rx-009:15:240
2357795991412,1cyclictest60350irq/132-enp0s29f1:rx-008:39:270
2357795991412,1cyclictest60350irq/132-enp0s29f1:rx-007:30:190
2357795991411,2cyclictest60350irq/132-enp0s29f1:rx-011:40:080
2357795991411,2cyclictest2697631-21fschecks_count12:35:130
2357795991411,2cyclictest2566937-21turbostat10:30:000
235780599139,3cyclictest2489001-21kworker/u8:3+flush-259:010:00:213
235780599139,2cyclictest0-21swapper/310:05:223
235780599138,4cyclictest2315374-21kworker/u8:3+flush-259:007:55:183
235780599138,4cyclictest2315374-21kworker/u8:3+flush-259:007:55:173
235780599131,5cyclictest2109693-21snmpd10:45:143
2357805991310,2cyclictest2629527-21idleruntime-cro11:30:003
2357805991310,2cyclictest2414810-21kworker/u8:1+events_unbound09:05:233
235780399139,3cyclictest2671593-21apt-get12:10:112
2357803991311,1cyclictest0-21swapper/209:10:162
2357803991310,2cyclictest500-21systemd-logind12:00:012
2357803991310,2cyclictest2608661-21kworker/u8:1+flush-259:011:20:202
2357803991310,2cyclictest2378663-21cpuspeed_turbos07:30:132
2357803991310,2cyclictest0-21swapper/211:00:242
235779999138,3cyclictest2357766-21kworker/u8:1+flush-259:007:35:001
235779999137,4cyclictest2357986-21/usr/sbin/munin07:10:251
2357799991311,1cyclictest0-21swapper/110:25:001
2357795991312,1cyclictest60350irq/132-enp0s29f1:rx-009:37:130
2357795991311,1cyclictest60350irq/132-enp0s29f1:rx-011:30:240
2357795991311,1cyclictest60350irq/132-enp0s29f1:rx-010:00:170
2357795991311,1cyclictest60350irq/132-enp0s29f1:rx-008:54:570
2357795991311,1cyclictest60350irq/132-enp0s29f1:rx-008:30:110
2357795991310,2cyclictest60350irq/132-enp0s29f1:rx-008:05:180
2357795991310,2cyclictest60350irq/132-enp0s29f1:rx-008:05:180
2357795991310,1cyclictest0-21swapper/008:15:010
235780599129,2cyclictest2701946-21kworker/u8:0+flush-259:012:40:003
235780599128,3cyclictest2567167-21kworker/u8:4+flush-259:010:35:173
235780599128,3cyclictest2447933-21cpuspeed_turbos08:35:133
235780599125,4cyclictest2593041-21cat10:55:013
235780599121,1cyclictest23589312cut07:10:223
235780399129,2cyclictest2676822-21cpuspeed_turbos12:15:122
235780399129,2cyclictest2625051-21irqcore11:25:172
235780399129,2cyclictest2603622-21cpuspeed_turbos11:05:142
235780399129,2cyclictest2598125-21kworker/u8:0+flush-259:011:43:472
235780399129,2cyclictest2447569-21idleruntime-cro08:35:012
235780399128,3cyclictest2682092-21fschecks_count12:20:142
235780399128,3cyclictest2645703-21kworker/u8:3+flush-259:012:02:472
235780399127,4cyclictest2452829-21kworker/u8:2+flush-259:008:45:252
2357803991210,1cyclictest0-21swapper/208:50:172
235779999129,2cyclictest2546697-21cpuspeed_turbos10:10:111
235779999129,2cyclictest2421304-21cpuspeed_turbos08:10:141
235779999129,2cyclictest2357766-21kworker/u8:1+flush-259:007:15:321
235779999129,2cyclictest0-21swapper/109:55:001
2357799991210,1cyclictest0-21swapper/110:45:001
2357799991210,1cyclictest0-21swapper/110:40:001
2357795991210,1cyclictest60350irq/132-enp0s29f1:rx-007:37:240
235780599119,1cyclictest0-21swapper/309:40:253
235780599118,2cyclictest2404550-21unixbench_multi07:50:263
235780599115,4cyclictest335557-21systemd-journal10:15:003
235780599115,4cyclictest2619797-21sshd11:20:163
235780599114,5cyclictest2426663-21base6408:15:013
235780599114,4cyclictest335557-21systemd-journal10:00:003
235780599113,5cyclictest335557-21systemd-journal11:30:163
235780599111,7cyclictest2671596-21taskset12:10:123
235780399119,1cyclictest2373639-21cut07:25:142
235780399118,2cyclictest2415250-21unixbench_multi08:00:252
235780399117,3cyclictest2541414-21kworker/u8:0+flush-259:010:05:242
235780399115,4cyclictest2546770-21diskstats10:10:122
235779999118,2cyclictest0-21swapper/109:25:011
235780599106,2cyclictest0-21swapper/311:05:203
235780599101,8cyclictest2504939-21latency_hist09:30:013
235780599100,3cyclictest2572160-21apt10:35:003
235780399108,1cyclictest0-21swapper/212:30:172
235780399108,1cyclictest0-21swapper/210:45:002
235780399105,3cyclictest2526123-21cut09:50:142
235779999108,1cyclictest0-21swapper/111:30:011
235779999108,1cyclictest0-21swapper/109:35:131
23578059996,1cyclictest0-21swapper/309:30:173
23578059993,3cyclictest2562454-21/usr/sbin/munin10:25:163
23578039997,1cyclictest0-21swapper/212:35:172
23578039997,1cyclictest0-21swapper/210:20:162
23578039995,3cyclictest2551806-21apt-get10:15:112
23577999996,2cyclictest2582942-21cpuspeed_turbos10:45:141
23577999996,2cyclictest0-21swapper/111:30:181
23577999995,3cyclictest311ktimers/110:15:111
23578059981,4cyclictest2650896-21/usr/sbin/munin11:50:113
23578039986,1cyclictest0-21swapper/209:15:142
23577999985,2cyclictest2687325-21fschecks_time12:25:161
23577999981,5cyclictest2634937-21/usr/sbin/munin11:35:151
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional