You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-02 - 03:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Tue Jun 02, 2026 00:44:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2240963994542,2cyclictest2458723-21kworker/u8:0+events_unbound23:00:220
2240963994542,2cyclictest2360158-21kworker/u8:1+events_unbound21:05:240
2240973994439,3cyclictest2510740-21kworker/u8:3+flush-259:000:00:253
2240970994441,2cyclictest2323529-21gpgv20:30:012
2240963994438,5cyclictest2504631-21apt-get23:20:190
2240963994338,2cyclictest2360158-21kworker/u8:1+events_unbound21:15:250
2240963994240,2cyclictest3375926-21kworker/u8:4+events_unbound20:25:130
2240963994240,1cyclictest3375926-21kworker/u8:4+flush-259:019:10:230
2240963994239,2cyclictest2510740-21kworker/u8:3+events_unbound00:00:210
2240963994239,2cyclictest2421906-21kworker/u8:0+events_unbound22:15:230
2240963994138,2cyclictest2447443-21kworker/u8:2+events_unbound22:50:220
2240963994037,2cyclictest2282024-21kworker/u8:0+flush-259:021:40:240
2240963994034,4cyclictest2520115-21ntpq23:35:210
2240963994033,2cyclictest2577407-21kworker/u8:0+events_unbound00:40:010
2240973993932,5cyclictest2406938-21cat21:50:013
2240967993933,4cyclictest2255498-21ntpq19:20:211
2240963993936,2cyclictest3375926-21kworker/u8:4+events_unbound20:05:200
2240963993936,2cyclictest2510740-21kworker/u8:3+events_unbound23:40:230
2240963993936,2cyclictest2307902-21kworker/u8:3+events_unbound21:25:190
2240970993835,2cyclictest2437883-21kworker/u8:4+events_unbound22:25:292
2240967993835,2cyclictest2307902-21kworker/u8:3+flush-259:020:35:211
2240963993836,2cyclictest3375926-21kworker/u8:4+events_unbound19:15:220
2240963993835,2cyclictest2447443-21kworker/u8:2+events_unbound23:10:230
2240963993835,2cyclictest2256404-21kworker/u8:1+events_unbound19:35:220
2240963993835,2cyclictest2208712-21kworker/u8:0+events_unbound19:20:130
2240970993735,1cyclictest2557431-21fwupd00:13:082
2240970993734,2cyclictest2447443-21kworker/u8:2+events_unbound23:28:262
2240970993734,2cyclictest2447443-21kworker/u8:2+events_unbound23:24:262
2240970993733,3cyclictest2360158-21kworker/u8:1+events_unbound22:01:252
2240967993734,2cyclictest2256404-21kworker/u8:1+flush-259:019:45:261
2240963993734,2cyclictest2484090-21kworker/u8:1+events_unbound23:05:190
2240970993634,2cyclictest2458723-21kworker/u8:0+events_unbound22:50:292
2240970993632,3cyclictest2256404-21kworker/u8:1+events_unbound19:31:262
2240967993629,5cyclictest335557-21systemd-journal23:48:251
2240970993532,2cyclictest3375926-21kworker/u8:4+events_unbound20:02:262
2240970993532,2cyclictest3375926-21kworker/u8:4+events_unbound19:27:262
2240970993532,2cyclictest2458723-21kworker/u8:0+events_unbound22:57:542
2240970993532,2cyclictest2360158-21kworker/u8:1+events_unbound21:22:262
2240970993531,3cyclictest2447443-21kworker/u8:2+events_unbound23:41:262
2240967993532,2cyclictest2324102-21apt-get20:30:121
2240967993531,3cyclictest2447443-21kworker/u8:2+flush-259:022:35:191
2240967993531,3cyclictest2447443-21kworker/u8:2+events_unbound00:13:141
2240963993532,2cyclictest2561805-21kworker/u8:3+events_unbound00:30:210
2240963993532,2cyclictest2437883-21kworker/u8:4+flush-259:022:20:160
2240970993432,2cyclictest3375926-21kworker/u8:4+events_unbound20:32:492
2240970993432,2cyclictest2307902-21kworker/u8:3+events_unbound20:38:252
2240963993430,3cyclictest2307902-21kworker/u8:3+events_unbound20:30:240
2240963993428,4cyclictest2369392-21ntpq21:10:220
2240970993331,2cyclictest2427375-21kworker/u8:2+events_unbound22:13:012
2240970993330,2cyclictest3375926-21kworker/u8:4+events_unbound19:55:272
2240963993332,1cyclictest3375926-21kworker/u8:4+flush-259:019:30:210
2240963993330,2cyclictest3375926-21kworker/u8:4+flush-259:020:00:250
2240963993330,2cyclictest2437395-21kworker/u8:1+events_unbound22:45:250
2240963993330,2cyclictest2344333-21kworker/u8:1+events_unbound20:50:210
2240973993227,3cyclictest2510740-21kworker/u8:3+flush-259:023:40:013
2240970993230,2cyclictest3375926-21kworker/u8:4+events_unbound19:12:382
2240963993229,2cyclictest2437395-21kworker/u8:1+events_unbound22:40:250
2240963993228,3cyclictest2417315-21apt-get22:00:110
2240970993129,2cyclictest2437395-21kworker/u8:1+events_unbound22:17:402
2240970993129,2cyclictest2421906-21kworker/u8:0+events_unbound22:07:262
2240967993128,2cyclictest2282024-21kworker/u8:0+flush-259:020:15:211
2240967993127,3cyclictest2360158-21kworker/u8:1+flush-259:021:10:201
2240967993125,4cyclictest2323433-21http20:30:011
2240963993129,2cyclictest2395999-21kworker/u8:2+flush-259:021:55:250
2240963993128,2cyclictest2484090-21kworker/u8:1+events_unbound23:53:020
2240963993126,2cyclictest2282024-21kworker/u8:0+events_unbound21:20:210
2240973993025,4cyclictest2395999-21kworker/u8:2+flush-259:021:45:003
2240967993028,1cyclictest2282024-21kworker/u8:0+flush-259:019:55:001
2240967993026,3cyclictest2484090-21kworker/u8:1+events_unbound23:05:171
2240967993026,3cyclictest2266299-21kworker/u8:2+flush-259:019:39:591
2240967993024,4cyclictest335557-21systemd-journal20:12:451
2240967993022,3cyclictest2282024-21kworker/u8:0+flush-259:020:55:251
2240963993028,2cyclictest2437883-21kworker/u8:4+flush-259:022:25:240
2240963993028,2cyclictest2395999-21kworker/u8:2+events_unbound21:45:250
2240970992927,2cyclictest2484090-21kworker/u8:1+events_unbound23:57:262
2240970992927,2cyclictest2447443-21kworker/u8:2+events_unbound23:08:092
2240970992926,2cyclictest2282024-21kworker/u8:0+events_unbound21:41:252
2240967992926,2cyclictest2395999-21kworker/u8:2+events_unbound22:00:201
2240967992925,3cyclictest2536763-21apt-get23:55:131
2240967992925,2cyclictest2401374-21kworker/u8:3+flush-259:021:45:191
2240963992927,2cyclictest2282024-21kworker/u8:0+events_unbound20:55:170
2240963992926,2cyclictest2307902-21kworker/u8:3+flush-259:021:00:240
2240963992923,4cyclictest335557-21systemd-journal00:10:010
2240970992825,2cyclictest3375926-21kworker/u8:4+events_unbound20:22:252
2240970992825,2cyclictest2395999-21kworker/u8:2+events_unbound21:51:262
2240970992824,3cyclictest2447443-21kworker/u8:2+events_unbound00:09:252
2240970992823,4cyclictest335557-21systemd-journal21:20:002
2240967992825,2cyclictest2307902-21kworker/u8:3+flush-259:021:05:261
2240967992824,3cyclictest3375926-21kworker/u8:4+flush-259:020:00:001
2240963992825,2cyclictest2282024-21kworker/u8:0+flush-259:019:50:200
2240963992821,5cyclictest2411002-21ntpq21:50:210
2240973992721,4cyclictest335557-21systemd-journal20:59:253
2240973992721,4cyclictest2447443-21kworker/u8:2+flush-259:022:50:173
2240970992725,2cyclictest2561805-21kworker/u8:3+events_unbound00:15:572
2240970992724,2cyclictest2307902-21kworker/u8:3+events_unbound21:34:562
2240970992724,2cyclictest2307902-21kworker/u8:3+events_unbound21:12:562
2240967992724,2cyclictest2484090-21kworker/u8:1+flush-259:000:05:201
2240967992722,2cyclictest2458723-21kworker/u8:0+flush-259:022:55:161
2240963992724,2cyclictest2447443-21kworker/u8:2+flush-259:023:25:250
2240963992724,2cyclictest2447443-21kworker/u8:2+events_unbound23:45:220
2240973992620,4cyclictest2380540-21latency_hist21:25:003
2240970992624,2cyclictest3375926-21kworker/u8:4+events_unbound19:16:272
2240970992624,2cyclictest2510740-21kworker/u8:3+events_unbound23:35:252
2240970992624,2cyclictest2360158-21kworker/u8:1+events_unbound21:07:552
2240970992624,2cyclictest2282024-21kworker/u8:0+events_unbound21:37:312
2240970992624,2cyclictest2266299-21kworker/u8:2+events_unbound19:37:432
2240970992622,3cyclictest2448446-21base6422:30:012
2240970992620,4cyclictest335557-21systemd-journal20:07:242
2240967992623,2cyclictest3375926-21kworker/u8:4+flush-259:019:45:001
2240963992623,2cyclictest2256404-21kworker/u8:1+events_unbound19:40:160
2240963992622,3cyclictest2282024-21kworker/u8:0+flush-259:020:15:250
2240963992621,4cyclictest2447443-21kworker/u8:2+events_unbound22:30:120
2240973992520,3cyclictest2412155-21apt-get21:55:123
2240970992523,2cyclictest2256404-21kworker/u8:1+events_unbound19:47:032
2240970992522,2cyclictest2447443-21kworker/u8:2+events_unbound00:33:152
2240970992521,3cyclictest2484090-21kworker/u8:1+flush-259:000:40:002
2240967992522,2cyclictest2427614-21apt-get22:10:101
2240967992521,3cyclictest2484090-21kworker/u8:1+flush-259:023:35:151
224096799251,22cyclictest1-21systemd00:30:451
2240963992522,2cyclictest2266299-21kworker/u8:2+events_unbound19:45:200
2240963992521,3cyclictest2307902-21kworker/u8:3+events_unbound20:21:250
2240963992520,4cyclictest2484090-21kworker/u8:1+flush-259:000:10:170
2240973992419,4cyclictest2360158-21kworker/u8:1+flush-259:021:15:253
2240970992422,2cyclictest2447443-21kworker/u8:2+events_unbound23:16:262
2240970992421,2cyclictest2484090-21kworker/u8:1+events_unbound23:51:252
2240967992421,2cyclictest2510740-21kworker/u8:3+flush-259:023:40:201
2240967992421,2cyclictest2447443-21kworker/u8:2+flush-259:000:25:261
2240967992420,3cyclictest2437883-21kworker/u8:4+events_unbound22:20:201
2240967992420,3cyclictest2307902-21kworker/u8:3+events_unbound20:45:251
2240967992420,3cyclictest2282024-21kworker/u8:0+events_unbound21:30:141
2240967992418,3cyclictest2282024-21kworker/u8:0+events_unbound20:50:131
2240963992421,2cyclictest2447443-21kworker/u8:2+events_unbound00:25:270
2240963992420,3cyclictest3375926-21kworker/u8:4+events_unbound19:29:270
2240963992419,4cyclictest3375926-21kworker/u8:4+events_unbound20:12:090
2240973992319,3cyclictest2282024-21kworker/u8:0+flush-259:020:10:013
2240973992319,2cyclictest0-21swapper/321:10:003
2240970992322,1cyclictest2447443-21kworker/u8:2+events_unbound23:30:282
2240970992321,2cyclictest2458723-21kworker/u8:0+events_unbound23:03:262
2240970992321,2cyclictest2437883-21kworker/u8:4+events_unbound22:38:022
2240970992321,2cyclictest2437395-21kworker/u8:1+events_unbound22:48:032
2240970992321,2cyclictest2307902-21kworker/u8:3+events_unbound21:04:562
2240970992321,2cyclictest2282024-21kworker/u8:0+events_unbound19:53:192
2240970992319,2cyclictest2484090-21kworker/u8:1+events_unbound23:13:352
2240967992319,3cyclictest2484090-21kworker/u8:1+flush-259:023:30:251
2240967992319,3cyclictest2437395-21kworker/u8:1+flush-259:022:40:211
2240967992319,3cyclictest2334428-21apt-get20:40:131
2240963992321,2cyclictest2421906-21kworker/u8:0+events_unbound22:05:200
2240963992320,2cyclictest2447443-21kworker/u8:2+events_unbound23:56:260
2240963992319,3cyclictest2282024-21kworker/u8:0+events_unbound21:32:270
2240963992318,2cyclictest2458723-21kworker/u8:0+events_unbound22:55:140
2240973992216,4cyclictest335557-21systemd-journal21:27:253
2240970992220,2cyclictest2447443-21kworker/u8:2+events_unbound00:21:252
2240970992220,2cyclictest2360158-21kworker/u8:1+events_unbound21:57:272
2240970992220,2cyclictest2360158-21kworker/u8:1+events_unbound21:48:272
2240970992219,2cyclictest2458723-21kworker/u8:0+events_unbound22:42:262
2240970992219,2cyclictest2307902-21kworker/u8:3+events_unbound21:25:202
2240970992218,3cyclictest509-21rs:main2
2240967992219,2cyclictest2437883-21kworker/u8:4+flush-259:022:30:211
2240967992219,2cyclictest2437883-21kworker/u8:4+flush-259:022:25:261
2240967992218,3cyclictest2360158-21kworker/u8:1+events_unbound21:15:271
2240967992218,3cyclictest2307902-21kworker/u8:3+events_unbound21:29:261
2240967992217,2cyclictest2421906-21kworker/u8:0+events_unbound22:05:171
2240967992215,2cyclictest2421906-21kworker/u8:0+flush-259:022:15:211
2240963992219,2cyclictest2484090-21kworker/u8:1+flush-259:023:15:270
2240963992219,2cyclictest2282024-21kworker/u8:0+flush-259:019:55:160
2240973992116,4cyclictest2583545-21gpgv00:40:003
2240970992119,2cyclictest2344333-21kworker/u8:1+events_unbound20:57:182
2240970992119,2cyclictest2282024-21kworker/u8:0+events_unbound20:53:272
2240967992118,2cyclictest2484090-21kworker/u8:1+flush-259:023:50:201
2240967992118,2cyclictest2282024-21kworker/u8:0+events_unbound21:40:191
2240967992117,3cyclictest2282024-21kworker/u8:0+flush-259:021:02:261
2240963992118,2cyclictest2447443-21kworker/u8:2+events_unbound00:20:240
2240973992017,2cyclictest2492624-21kthreadcore23:10:193
2240973992016,3cyclictest2437883-21kworker/u8:4+flush-259:022:20:173
2240973992016,3cyclictest2421906-21kworker/u8:0+events_unbound22:05:233
2240973992015,4cyclictest2447443-21kworker/u8:2+flush-259:023:05:253
2240970992019,1cyclictest2307902-21kworker/u8:3+events_unbound20:47:182
2240970992018,2cyclictest2447443-21kworker/u8:2+events_unbound23:45:032
2240970992017,2cyclictest2541667-21kworker/u8:5+events_unbound00:01:272
2240970992017,2cyclictest2256404-21kworker/u8:1+events_unbound19:40:522
2240970992014,4cyclictest2334588-21diskstats20:40:162
2240967992017,2cyclictest3375926-21kworker/u8:4+events_unbound20:02:441
2240967992017,2cyclictest3375926-21kworker/u8:4+events_unbound19:28:261
2240967992017,2cyclictest2484090-21kworker/u8:1+events_unbound00:37:261
2240967992017,2cyclictest2484090-21kworker/u8:1+events_unbound00:15:161
2240967992016,3cyclictest2484090-21kworker/u8:1+events_unbound23:25:141
2240963992018,2cyclictest2307902-21kworker/u8:3+events_unbound20:36:260
2240963992017,2cyclictest2484090-21kworker/u8:1+events_unbound23:30:130
2240973991915,3cyclictest3375926-21kworker/u8:4+flush-259:020:20:253
2240973991913,4cyclictest335557-21systemd-journal21:46:263
2240973991913,4cyclictest335557-21systemd-journal00:20:013
2240970991916,2cyclictest2208712-21kworker/u8:0+events_unbound19:24:242
2240967991916,2cyclictest2541667-21kworker/u8:5+events_unbound00:03:271
2240967991916,2cyclictest2437395-21kworker/u8:1+flush-259:022:45:251
2240967991916,2cyclictest2401374-21kworker/u8:3+events_unbound21:50:281
2240963991916,2cyclictest2561805-21kworker/u8:3+events_unbound00:15:260
2240973991814,3cyclictest2307902-21kworker/u8:3+flush-259:020:20:013
2240973991813,4cyclictest2307902-21kworker/u8:3+events_unbound20:40:243
2240973991812,4cyclictest509-21rs:main3
224097399180,17cyclictest1-21systemd20:30:013
2240970991816,2cyclictest2437883-21kworker/u8:4+events_unbound22:24:562
2240970991813,3cyclictest2302956-21/usr/sbin/munin20:10:142
2240967991815,2cyclictest2447443-21kworker/u8:2+events_unbound00:20:151
2240967991815,2cyclictest2395999-21kworker/u8:2+events_unbound21:55:141
2240967991814,3cyclictest3375926-21kworker/u8:4+flush-259:019:30:231
2240967991814,3cyclictest2282024-21kworker/u8:0+events_unbound21:22:571
2240973991714,2cyclictest2261533-21munin-plugin-st19:29:593
2240973991712,3cyclictest2427375-21kworker/u8:2+flush-259:022:10:203
2240973991711,4cyclictest335557-21systemd-journal20:02:063
2240970991714,2cyclictest2561805-21kworker/u8:3+events_unbound00:25:102
2240967991715,2cyclictest3375926-21kworker/u8:4+events_unbound20:05:141
2240967991715,2cyclictest2458723-21kworker/u8:0+events_unbound23:00:151
2240967991713,3cyclictest2484090-21kworker/u8:1+events_unbound23:22:251
2240963991713,3cyclictest2427375-21kworker/u8:2+events_unbound22:12:260
2240963991713,3cyclictest2307902-21kworker/u8:3+flush-259:021:37:550
2240973991613,2cyclictest2271815-21idleruntime-cro19:40:003
2240973991612,3cyclictest2447443-21kworker/u8:2+flush-259:023:25:173
2240967991613,2cyclictest2484090-21kworker/u8:1+events_unbound23:13:271
2240967991613,2cyclictest2307902-21kworker/u8:3+flush-259:021:35:241
224097399158,5cyclictest2307882-21latency_hist20:15:013
2240973991512,2cyclictest2568626-21irqcore00:25:173
2240973991512,2cyclictest2501655-21tr23:20:173
2240973991512,2cyclictest2447929-21apt-get22:30:023
2240973991511,3cyclictest2307902-21kworker/u8:3+flush-259:020:45:183
2240973991511,2cyclictest2459376-21irqcore22:40:173
2240973991510,3cyclictest2531762-21diskstats23:50:143
2240963991512,2cyclictest2344333-21kworker/u8:1+flush-259:020:48:400
224097399148,4cyclictest2552676-21/usr/sbin/munin00:10:213
2240973991411,2cyclictest2567019-21ntp_kernel_err00:20:203
2240973991410,3cyclictest2447443-21kworker/u8:2+flush-259:023:45:283
2240973991410,3cyclictest2421906-21kworker/u8:0+flush-259:022:15:173
2240973991410,3cyclictest2307902-21kworker/u8:3+flush-259:020:35:173
2240973991410,3cyclictest0-21swapper/300:10:003
2240967991410,3cyclictest2282024-21kworker/u8:0+events_unbound20:20:031
2240963991412,1cyclictest60350irq/132-enp0s29f1:rx-020:40:260
2240963991410,3cyclictest2437395-21kworker/u8:1+events_unbound22:36:110
224097399139,2cyclictest0-21swapper/321:35:163
224097399131,3cyclictest2541644-21awk00:00:003
2240973991310,2cyclictest2458723-21kworker/u8:0+flush-259:023:04:303
2240973991310,2cyclictest2325123-21kthreadcore20:30:183
2240973991310,1cyclictest0-21swapper/322:50:003
224097099130,5cyclictest2241114-21cat19:10:012
224096799139,3cyclictest3375926-21kworker/u8:4+flush-259:019:12:301
2240967991310,2cyclictest2447443-21kworker/u8:2+events_unbound23:15:171
224097399128,2cyclictest2447929-21sh22:30:013
2240973991210,1cyclictest2479328-21unixbench_singl22:55:253
224096799129,2cyclictest2447443-21kworker/u8:2+flush-259:022:50:211
224096799129,2cyclictest2246409-21cpuspeed_turbos19:15:121
224097399118,2cyclictest2241243-21cpuspeed_turbos19:10:133
224097399115,4cyclictest2344697-21/usr/sbin/munin20:50:133
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional