You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-06 - 15:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Thu Aug 06, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
154402994238,3cyclictest335557-21systemd-journal20:17:391
154408993936,2cyclictest274360-21kworker/u8:3+flush-259:021:05:263
154405993934,4cyclictest335557-21systemd-journal23:45:412
154402993733,3cyclictest456885-21kworker/u8:3+flush-259:000:00:151
154398993733,3cyclictest509-21rs:main0
154405993633,2cyclictest90588-21kworker/u8:3+events_unbound19:10:012
154402993632,3cyclictest274360-21kworker/u8:3+events_unbound21:25:011
15439899360,35cyclictest1-21systemd21:50:330
154408993532,2cyclictest264602-21kworker/u8:0+flush-259:020:55:263
154408993529,4cyclictest461820-21latency_hist00:05:013
154398993529,4cyclictest305865-21latency_hist21:35:010
154408993430,3cyclictest175937-21kworker/u8:4+events_unbound20:20:003
154408993330,2cyclictest351974-21kworker/u8:3+events_unbound22:39:403
154408993329,3cyclictest175937-21kworker/u8:4+events_unbound19:45:213
154408993328,4cyclictest413937-21ntpq23:15:203
154408993328,4cyclictest413937-21ntpq23:15:203
154402993329,3cyclictest467241-21apt-get00:10:101
154402993329,3cyclictest211755-21kworker/u8:0+flush-259:020:35:241
154402993329,3cyclictest175937-21kworker/u8:4+events_unbound20:10:221
154408993228,3cyclictest351974-21kworker/u8:3+flush-259:022:30:433
154405993226,4cyclictest335557-21systemd-journal21:57:402
154408993128,2cyclictest175937-21kworker/u8:4+events_unbound19:35:013
154408993127,3cyclictest316217-21kworker/u8:1+events_unbound21:55:173
154408993127,3cyclictest259205-21kworker/u8:2+events_unbound20:50:213
154405993126,3cyclictest212133-21http20:05:012
154405993124,5cyclictest363540-21diskstats22:30:132
154402993128,2cyclictest316217-21kworker/u8:1+events_unbound21:50:151
154402993127,3cyclictest90588-21kworker/u8:3+flush-259:019:20:391
154402993127,3cyclictest351974-21kworker/u8:3+flush-259:022:25:011
154402993125,4cyclictest330853-21ntpq21:55:251
154398993127,3cyclictest415083-21apt-get23:20:110
154408993027,2cyclictest456885-21kworker/u8:3+flush-259:000:15:183
154408993027,2cyclictest357226-21kworker/u8:1+events_unbound23:55:203
154405993024,4cyclictest243962-21latency_hist20:35:002
154402993027,2cyclictest351974-21kworker/u8:3+flush-259:022:50:201
154402993027,2cyclictest175937-21kworker/u8:4+flush-259:019:45:231
154408992926,2cyclictest295599-21kworker/u8:2+flush-259:021:30:213
154408992925,3cyclictest420021-21kworker/u8:5+events_unbound00:05:253
154405992925,3cyclictest482635-21base6400:25:002
154405992924,3cyclictest295599-21kworker/u8:2+events_unbound21:45:192
154402992926,2cyclictest274360-21kworker/u8:3+flush-259:021:05:211
154402992926,2cyclictest222914-21kworker/u8:1+events_unbound20:40:181
154402992926,2cyclictest222914-21kworker/u8:1+events_unbound20:25:191
154398992926,2cyclictest90588-21kworker/u8:3+flush-259:019:10:240
154398992926,2cyclictest295599-21kworker/u8:2+flush-259:022:20:010
154408992825,2cyclictest90588-21kworker/u8:3+events_unbound19:15:173
154408992824,3cyclictest357226-21kworker/u8:1+flush-259:022:40:163
154402992825,2cyclictest259205-21kworker/u8:2+events_unbound20:56:421
154402992825,2cyclictest222914-21kworker/u8:1+events_unbound20:51:411
154402992824,3cyclictest373469-21kworker/u8:0+events_unbound23:30:171
154398992824,3cyclictest351974-21kworker/u8:3+flush-259:022:45:000
154408992724,2cyclictest211755-21kworker/u8:0+flush-259:020:20:153
154408992724,2cyclictest186295-21kworker/u8:2+flush-259:020:00:223
154408992723,3cyclictest316217-21kworker/u8:1+flush-259:022:05:183
154402992724,2cyclictest274360-21kworker/u8:3+events_unbound21:21:411
154402992723,3cyclictest295599-21kworker/u8:2+events_unbound22:17:401
154402992722,4cyclictest202052-21apt-get19:55:111
154398992724,2cyclictest351974-21kworker/u8:3+events_unbound22:30:020
154408992623,2cyclictest373469-21kworker/u8:0+events_unbound23:50:203
154408992623,2cyclictest357226-21kworker/u8:1+flush-259:023:40:233
154408992623,2cyclictest357226-21kworker/u8:1+events_unbound00:38:253
154408992623,2cyclictest295599-21kworker/u8:2+events_unbound22:25:203
154408992622,3cyclictest357226-21kworker/u8:1+events_unbound23:47:423
154408992622,3cyclictest351974-21kworker/u8:3+events_unbound22:51:423
154408992622,3cyclictest274360-21kworker/u8:3+events_unbound21:10:223
154402992623,2cyclictest295599-21kworker/u8:2+flush-259:022:00:211
154398992621,3cyclictest337129-21apt-get22:05:110
154408992522,2cyclictest90588-21kworker/u8:3+events_unbound19:20:183
154405992522,2cyclictest154600-21kworker/u8:2+flush-259:019:15:012
154405992521,3cyclictest295599-21kworker/u8:2+flush-259:022:25:112
154402992522,2cyclictest420021-21kworker/u8:5+flush-259:023:35:251
154402992522,2cyclictest295599-21kworker/u8:2+flush-259:021:30:211
154402992522,2cyclictest2303872-21kworker/u8:1+flush-259:019:25:211
154402992521,3cyclictest373469-21kworker/u8:0+events_unbound23:05:421
154402992521,3cyclictest295599-21kworker/u8:2+events_unbound21:43:421
154402992521,3cyclictest280353-21apt-get21:10:111
154402992521,3cyclictest186295-21kworker/u8:2+flush-259:020:05:281
154402992520,4cyclictest483176-21apt-get00:25:111
154398992522,2cyclictest357226-21kworker/u8:1+flush-259:023:55:170
154398992521,3cyclictest295599-21kworker/u8:2+flush-259:022:00:350
154398992521,3cyclictest211755-21kworker/u8:0+flush-259:020:25:250
154408992421,2cyclictest316217-21kworker/u8:1+events_unbound21:50:213
154408992419,3cyclictest306290-21diskstats21:35:143
154402992421,2cyclictest456885-21kworker/u8:3+flush-259:000:15:231
154402992421,2cyclictest420021-21kworker/u8:5+flush-259:000:10:001
154402992421,2cyclictest373469-21kworker/u8:0+flush-259:023:00:001
154402992420,3cyclictest456885-21kworker/u8:3+events_unbound00:30:251
154402992420,3cyclictest335557-21systemd-journal23:50:391
154402992420,3cyclictest316217-21kworker/u8:1+flush-259:022:05:231
154402992419,3cyclictest451327-21apt-get23:55:121
154408992320,2cyclictest222914-21kworker/u8:1+events_unbound21:15:283
154408992320,2cyclictest1321065-21kworker/u8:0+events_unbound19:53:403
154408992318,4cyclictest300737-21latency_hist21:30:013
154408992316,5cyclictest294718-21ntpq21:20:253
154405992318,4cyclictest346338-21ntpq22:10:212
154405992317,4cyclictest420001-21latency_hist23:25:002
154405992317,4cyclictest335557-21systemd-journal23:30:002
154402992319,3cyclictest212228-21gpgv20:05:011
154398992320,2cyclictest357226-21kworker/u8:1+events_unbound22:45:190
154398992319,2cyclictest456885-21kworker/u8:3+events_unbound00:00:250
154398992318,3cyclictest490-21dbus-daemon22:40:010
154408992220,2cyclictest394133-21kworker/u8:2+flush-259:023:20:193
154408992219,2cyclictest90588-21kworker/u8:3+events_unbound19:14:393
154408992219,2cyclictest186295-21kworker/u8:2+flush-259:020:05:233
154408992218,3cyclictest456885-21kworker/u8:3+flush-259:000:30:473
154408992218,3cyclictest170984-21apt-get19:25:123
154408992217,4cyclictest335557-21systemd-journal20:25:003
154402992219,2cyclictest394133-21kworker/u8:2+events_unbound23:20:261
154402992219,2cyclictest1321065-21kworker/u8:0+flush-259:019:30:211
154398992219,2cyclictest357226-21kworker/u8:1+events_unbound23:06:420
154398992219,2cyclictest1321065-21kworker/u8:0+events_unbound19:35:210
154398992218,3cyclictest477326-21kworker/u8:2+events_unbound00:20:090
154398992218,3cyclictest211755-21kworker/u8:0+events_unbound20:19:400
154398992218,3cyclictest175937-21kworker/u8:4+events_unbound19:40:090
154398992217,4cyclictest357226-21kworker/u8:1+events_unbound22:55:220
154408992119,2cyclictest249135-21kworker/u8:3+flush-259:020:45:243
154408992118,2cyclictest373469-21kworker/u8:0+events_unbound23:37:433
154408992118,2cyclictest357226-21kworker/u8:1+flush-259:022:45:413
154408992118,2cyclictest357226-21kworker/u8:1+events_unbound23:00:243
154408992118,2cyclictest351974-21kworker/u8:3+events_unbound22:21:203
154402992118,2cyclictest316217-21kworker/u8:1+flush-259:022:10:161
154402992118,2cyclictest249135-21kworker/u8:3+events_unbound20:45:161
154398992118,2cyclictest186295-21kworker/u8:2+flush-259:020:05:240
154398992116,4cyclictest170834-21cat19:25:000
154408992017,2cyclictest373469-21kworker/u8:0+flush-259:023:15:013
154408992017,2cyclictest274360-21kworker/u8:3+events_unbound21:40:243
154408992016,3cyclictest357226-21kworker/u8:1+events_unbound23:07:423
154402992017,2cyclictest456885-21kworker/u8:3+flush-259:000:20:271
154402992016,3cyclictest420021-21kworker/u8:5+events_unbound23:28:401
154398992018,1cyclictest243965-21latency_hist20:35:000
154398992016,3cyclictest351974-21kworker/u8:3+flush-259:022:20:210
154398992016,3cyclictest2303872-21kworker/u8:1+events_unbound19:30:130
154398992016,3cyclictest222914-21kworker/u8:1+events_unbound21:13:420
154398992016,3cyclictest211755-21kworker/u8:0+flush-259:020:35:190
154398992016,3cyclictest1321065-21kworker/u8:0+flush-259:019:50:190
154398992016,2cyclictest295599-21kworker/u8:2+flush-259:022:25:170
154398992015,3cyclictest316217-21kworker/u8:1+flush-259:022:10:220
154398992015,3cyclictest222914-21kworker/u8:1+events_unbound21:20:010
154408991916,2cyclictest357226-21kworker/u8:1+flush-259:022:55:263
154408991915,3cyclictest456885-21kworker/u8:3+events_unbound00:24:083
154405991915,3cyclictest274360-21kworker/u8:3+events_unbound21:40:222
154402991916,2cyclictest373469-21kworker/u8:0+events_unbound23:15:501
154402991916,2cyclictest373469-21kworker/u8:0+events_unbound23:15:491
154402991916,2cyclictest357226-21kworker/u8:1+events_unbound23:43:411
154398991916,2cyclictest357226-21kworker/u8:1+flush-259:023:00:470
154398991916,2cyclictest259205-21kworker/u8:2+flush-259:021:00:150
154398991916,2cyclictest259205-21kworker/u8:2+events_unbound20:50:230
154398991915,3cyclictest357226-21kworker/u8:1+events_unbound23:46:580
154398991913,4cyclictest295599-21kworker/u8:2+flush-259:021:35:210
154408991815,2cyclictest295599-21kworker/u8:2+events_unbound21:45:333
154408991814,3cyclictest175937-21kworker/u8:4+events_unbound20:10:113
154405991815,2cyclictest306550-21irqcore21:35:162
154405991815,2cyclictest249135-21kworker/u8:3+events_unbound20:45:202
154405991815,2cyclictest228770-21irqcore20:20:172
154405991813,3cyclictest347434-21/usr/sbin/munin22:15:142
154402991815,2cyclictest90588-21kworker/u8:3+flush-259:019:10:211
154402991815,2cyclictest264602-21kworker/u8:0+events_unbound21:00:231
154402991813,4cyclictest285485-21/usr/sbin/munin21:15:211
154398991814,3cyclictest357226-21kworker/u8:1+events_unbound00:06:080
154398991814,3cyclictest186295-21kworker/u8:2+flush-259:020:00:170
154408991714,2cyclictest477326-21kworker/u8:2+events_unbound00:25:043
154408991714,2cyclictest175937-21kworker/u8:4+events_unbound19:44:513
154405991713,3cyclictest222914-21kworker/u8:1+flush-259:020:40:212
154405991712,4cyclictest270178-21diskstats21:00:122
154402991714,2cyclictest90588-21kworker/u8:3+flush-259:019:15:211
154402991714,2cyclictest373469-21kworker/u8:0+flush-259:023:10:201
154402991714,2cyclictest357226-21kworker/u8:1+flush-259:022:45:201
154402991714,2cyclictest211755-21kworker/u8:0+events_unbound20:30:411
154402991714,2cyclictest1321065-21kworker/u8:0+flush-259:019:40:011
154398991714,2cyclictest420021-21kworker/u8:5+flush-259:023:40:000
154398991713,3cyclictest60350irq/132-enp0s29f1:rx-023:15:200
154398991713,3cyclictest60350irq/132-enp0s29f1:rx-023:15:200
154398991713,3cyclictest394133-21kworker/u8:2+events_unbound23:27:420
154398991713,3cyclictest249135-21kworker/u8:3+events_unbound20:50:000
154398991713,3cyclictest175937-21kworker/u8:4+events_unbound20:13:390
154398991712,3cyclictest274360-21kworker/u8:3+flush-259:021:20:210
154408991613,2cyclictest222914-21kworker/u8:1+events_unbound20:35:153
154408991613,2cyclictest211755-21kworker/u8:0+events_unbound20:41:393
154408991612,3cyclictest456885-21kworker/u8:3+events_unbound00:13:073
154408991612,3cyclictest316217-21kworker/u8:1+events_unbound22:13:403
154408991612,3cyclictest259205-21kworker/u8:2+flush-259:021:00:183
154405991613,2cyclictest2971-21cron23:40:002
154405991613,2cyclictest1321065-21kworker/u8:0+flush-259:019:35:172
154405991613,1cyclictest0-21swapper/200:10:002
154398991614,1cyclictest60350irq/132-enp0s29f1:rx-021:55:270
154398991614,1cyclictest60350irq/132-enp0s29f1:rx-021:40:240
154398991614,1cyclictest60350irq/132-enp0s29f1:rx-000:35:240
154398991614,1cyclictest60350irq/132-enp0s29f1:rx-000:15:230
154398991613,2cyclictest60350irq/132-enp0s29f1:rx-023:50:200
154398991612,3cyclictest351974-21kworker/u8:3+flush-259:022:50:240
154398991612,3cyclictest274360-21kworker/u8:3+flush-259:021:25:260
154408991512,2cyclictest373469-21kworker/u8:0+events_unbound23:32:213
154408991512,2cyclictest295599-21kworker/u8:2+events_unbound22:15:343
15440599150,5cyclictest383809-21munin-run22:49:592
154402991513,1cyclictest363195-21latency_hist22:30:021
154402991512,3cyclictest295599-21kworker/u8:2+events_unbound21:45:361
154402991512,2cyclictest357226-21kworker/u8:1+events_unbound22:37:431
154402991512,2cyclictest1321065-21kworker/u8:0+events_unbound19:41:391
154398991513,1cyclictest60350irq/132-enp0s29f1:rx-023:40:160
154398991513,1cyclictest60350irq/132-enp0s29f1:rx-023:31:400
154398991513,1cyclictest60350irq/132-enp0s29f1:rx-000:30:260
154398991513,1cyclictest60350irq/132-enp0s29f1:rx-000:11:420
154398991512,2cyclictest60350irq/132-enp0s29f1:rx-020:41:080
154398991512,2cyclictest60350irq/132-enp0s29f1:rx-020:20:130
154398991512,2cyclictest60350irq/132-enp0s29f1:rx-019:48:510
154398991512,2cyclictest60350irq/132-enp0s29f1:rx-019:20:290
154398991512,2cyclictest2303872-21kworker/u8:1+events_unbound19:15:030
154398991511,3cyclictest264602-21kworker/u8:0+events_unbound20:55:250
154408991411,2cyclictest211755-21kworker/u8:0+flush-259:020:30:263
154405991412,1cyclictest222914-21kworker/u8:1+flush-259:020:40:002
154402991412,2cyclictest357226-21kworker/u8:1+events_unbound23:49:561
154402991411,2cyclictest357226-21kworker/u8:1+flush-259:000:35:171
154402991410,3cyclictest357226-21kworker/u8:1+events_unbound23:00:441
154402991410,3cyclictest1321065-21kworker/u8:0+events_unbound19:50:021
154398991411,2cyclictest60350irq/132-enp0s29f1:rx-019:56:360
15440899138,4cyclictest335557-21systemd-journal23:25:513
154408991310,3cyclictest186295-21kworker/u8:2+events_unbound19:55:103
154408991310,2cyclictest1321065-21kworker/u8:0+flush-259:019:35:393
15440599139,3cyclictest2303872-21kworker/u8:1+flush-259:019:30:142
15440599137,1cyclictest206942-21munin-plugin-st20:00:012
154405991311,1cyclictest0-21swapper/223:05:002
154405991310,2cyclictest357226-21kworker/u8:1+flush-259:023:50:152
154405991310,1cyclictest0-21swapper/222:10:002
154402991310,3cyclictest295599-21kworker/u8:2+events_unbound21:35:401
15439899139,3cyclictest60350irq/132-enp0s29f1:rx-023:10:120
15440899128,3cyclictest316217-21kworker/u8:1+events_unbound22:03:253
15440599129,2cyclictest164691-21unixbench_multi19:15:262
15440599128,3cyclictest456216-21apt-get00:00:022
15440599128,3cyclictest373469-21kworker/u8:0+flush-259:023:10:242
15440599128,3cyclictest373469-21kworker/u8:0+events_unbound23:30:152
15440599128,3cyclictest357226-21kworker/u8:1+events_unbound22:40:242
15440599126,5cyclictest335557-21systemd-journal21:25:002
15440599121,3cyclictest336858-21awk22:05:012
15440599120,2cyclictest493284-21awk00:35:002
15440299128,3cyclictest357226-21kworker/u8:1+events_unbound22:43:001
15440599119,1cyclictest0-21swapper/221:50:252
15440599118,2cyclictest388966-21systemd-run22:55:002
15440599118,2cyclictest303328-21kthreadcore21:30:182
15440599118,2cyclictest295888-21cpuspeed_turbos21:25:142
15440599118,1cyclictest0-21swapper/222:39:592
15440599117,3cyclictest285231-21journal-offline21:15:002
15440599115,4cyclictest228072-21latency_hist20:20:002
15439899118,2cyclictest60350irq/132-enp0s29f1:rx-021:45:470
15440599107,2cyclictest466995-21kworker/u8:0+flush-259:000:10:152
15440599107,2cyclictest275220-21cpuspeed_turbos21:05:152
1544059996,2cyclictest171243-21fschecks_time19:25:142
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional