You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-29 - 05:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Wed Jul 29, 2026 00:44:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
201739995955,3cyclictest367815-21kworker/u8:1+flush-259:023:05:000
201739995754,2cyclictest367815-21kworker/u8:1+flush-259:022:20:010
201741995441,10cyclictest264000-21latency_hist20:10:011
201749995047,2cyclictest383907-21kworker/u8:0+events_unbound22:07:543
201749994946,2cyclictest435528-21kworker/u8:4+events_unbound23:50:023
201739994743,3cyclictest289521-21kworker/u8:3+flush-259:021:10:540
201744994641,3cyclictest335557-21systemd-journal21:26:152
201749994542,2cyclictest435528-21kworker/u8:4+events_unbound23:09:583
201749994542,2cyclictest331682-21kworker/u8:0+events_unbound21:30:543
201741994537,6cyclictest347130-21latency_hist21:30:001
201739994542,2cyclictest477640-21kworker/u8:1+flush-259:000:30:550
201749994441,2cyclictest342002-21kworker/u8:2+events_unbound21:46:183
201741994438,4cyclictest414639-21latency_hist22:35:001
201741994438,4cyclictest335557-21systemd-journal00:10:001
201749994240,1cyclictest414541-21kworker/u8:0+events_unbound22:46:323
201739994239,2cyclictest289473-21kworker/u8:2+flush-259:020:45:540
201749994139,2cyclictest289521-21kworker/u8:3+events_unbound20:41:073
201744994136,3cyclictest503579-21latency_hist00:00:012
201741994135,4cyclictest483084-21/usr/sbin/munin23:40:131
201739994137,3cyclictest435528-21kworker/u8:4+flush-259:000:07:020
201741994034,4cyclictest357374-21kworker/u8:3+flush-259:021:40:011
201741994032,5cyclictest243432-21latency_hist19:50:001
201741993932,4cyclictest383244-21latency_hist22:05:011
201739993936,2cyclictest201258-21kworker/u8:2+flush-259:019:21:010
201739993935,3cyclictest367815-21kworker/u8:1+flush-259:022:01:200
201739993734,2cyclictest357374-21kworker/u8:3+events_unbound21:55:220
201739993733,3cyclictest201258-21kworker/u8:2+flush-259:019:16:080
201749993632,3cyclictest509-21rs:main3
201744993632,3cyclictest367815-21kworker/u8:1+flush-259:022:10:012
201741993628,4cyclictest326442-21latency_hist21:10:011
201744993531,3cyclictest335557-21systemd-journal21:50:532
201744993530,3cyclictest335557-21systemd-journal23:45:012
201741993425,6cyclictest300179-21latency_hist20:45:011
201739993429,2cyclictest357374-21kworker/u8:3+events_unbound21:54:530
201739993330,2cyclictest289473-21kworker/u8:2+flush-259:021:05:010
201739993329,3cyclictest316127-21kworker/u8:1+events_unbound21:26:540
201739993327,4cyclictest201662-21latency_hist19:10:000
201739993229,2cyclictest435528-21kworker/u8:4+events_unbound23:35:230
201739993229,2cyclictest435528-21kworker/u8:4+events_unbound23:20:000
201739993228,3cyclictest403916-21kworker/u8:3+flush-259:022:36:550
201744993127,3cyclictest440618-21gpgv23:00:002
201744993127,3cyclictest335557-21systemd-journal22:30:002
201744993125,4cyclictest335557-21systemd-journal21:16:162
201741993126,3cyclictest524877-21/usr/sbin/munin00:20:231
201739993128,2cyclictest435528-21kworker/u8:4+events_unbound23:50:240
201739993128,2cyclictest435528-21kworker/u8:4+events_unbound23:25:200
201739993128,2cyclictest398403-21kworker/u8:2+flush-259:022:30:120
201739993128,2cyclictest316127-21kworker/u8:1+events_unbound21:30:160
201739993127,3cyclictest498638-21kworker/u8:3+events_unbound00:10:200
201739993127,3cyclictest263673-21kworker/u8:4+events_unbound20:15:150
201739993027,2cyclictest498638-21kworker/u8:3+events_unbound00:15:220
201739993027,2cyclictest316127-21kworker/u8:1+flush-259:021:20:120
201739993027,2cyclictest289521-21kworker/u8:3+flush-259:020:40:000
201739993026,3cyclictest498638-21kworker/u8:3+events_unbound00:20:030
201739993026,3cyclictest289473-21kworker/u8:2+flush-259:020:56:060
201744992923,4cyclictest508240-21ntpq00:00:212
201739992927,2cyclictest403916-21kworker/u8:3+events_unbound22:50:020
201739992926,2cyclictest487796-21kworker/u8:2+events_unbound23:45:240
201739992926,2cyclictest414541-21kworker/u8:0+flush-259:022:45:260
201739992925,3cyclictest289521-21kworker/u8:3+events_unbound20:36:550
201739992924,2cyclictest263673-21kworker/u8:4+flush-259:020:30:230
201739992923,3cyclictest331682-21kworker/u8:0+events_unbound21:39:540
201749992824,2cyclictest398403-21kworker/u8:2+events_unbound22:25:003
201749992823,3cyclictest335557-21systemd-journal19:56:013
201744992824,3cyclictest331682-21kworker/u8:0+flush-259:021:35:012
201741992824,3cyclictest248424-21kworker/u8:0+events_unbound20:15:191
201741992823,3cyclictest217416-21/usr/sbin/munin19:25:241
201741992821,5cyclictest472490-21latency_hist23:30:011
201739992825,2cyclictest357374-21kworker/u8:3+events_unbound21:42:540
201739992825,2cyclictest248424-21kworker/u8:0+events_unbound19:55:230
201739992825,2cyclictest201258-21kworker/u8:2+events_unbound19:45:170
201739992821,5cyclictest283750-21ntpq20:25:200
201749992725,2cyclictest316127-21kworker/u8:1+events_unbound21:00:533
201749992722,3cyclictest519500-21latency_hist00:15:013
201744992722,4cyclictest335557-21systemd-journal20:05:012
201739992723,3cyclictest414541-21kworker/u8:0+events_unbound23:12:590
201749992622,3cyclictest201258-21kworker/u8:2+flush-259:019:50:173
201741992617,6cyclictest335557-21systemd-journal00:30:001
201739992623,2cyclictest435528-21kworker/u8:4+events_unbound00:00:190
201739992623,2cyclictest383907-21kworker/u8:0+events_unbound22:10:230
201739992623,2cyclictest278461-21kworker/u8:1+events_unbound20:21:540
201739992622,3cyclictest398403-21kworker/u8:2+events_unbound22:25:540
201749992523,2cyclictest316127-21kworker/u8:1+events_unbound21:22:553
201749992523,2cyclictest248424-21kworker/u8:0+events_unbound20:03:553
201744992519,4cyclictest222978-21cat19:30:012
201741992520,3cyclictest503702-21gpgv00:00:001
201741992518,5cyclictest212023-21latency_hist19:20:011
201741992517,5cyclictest434438-21ntpq22:50:211
201739992522,2cyclictest201258-21kworker/u8:2+flush-259:019:10:200
201739992522,2cyclictest201258-21kworker/u8:2+events_unbound19:50:250
201749992422,2cyclictest398403-21kworker/u8:2+events_unbound22:29:543
201749992422,2cyclictest201258-21kworker/u8:2+events_unbound19:42:543
201741992416,5cyclictest279507-21latency_hist20:25:011
201739992421,2cyclictest414541-21kworker/u8:0+events_unbound23:30:150
201739992421,2cyclictest342002-21kworker/u8:2+events_unbound21:45:250
201744992319,3cyclictest222470-21gpgv19:30:002
201744992317,4cyclictest284669-21latency_hist20:30:012
201741992317,4cyclictest335557-21systemd-journal19:10:521
201739992320,2cyclictest493900-21kworker/u8:0+events_unbound23:55:230
201739992320,2cyclictest403916-21kworker/u8:3+events_unbound22:44:550
201739992319,3cyclictest142479-21kworker/u8:1+events_unbound19:30:120
201739992318,2cyclictest316127-21kworker/u8:1+events_unbound21:15:190
201749992219,2cyclictest342002-21kworker/u8:2+events_unbound21:51:543
201741992217,4cyclictest212289-21apt-get19:20:111
201741992217,3cyclictest316127-21kworker/u8:1+flush-259:021:10:161
201741992216,4cyclictest408558-21ntpq22:25:191
201741992215,5cyclictest545333-21latency_hist00:40:021
201741992214,5cyclictest335557-21systemd-journal20:59:591
201739992219,2cyclictest357374-21kworker/u8:3+events_unbound22:05:550
201739992219,2cyclictest216832-21kworker/u8:3+flush-259:019:25:140
201749992118,2cyclictest342002-21kworker/u8:2+flush-259:021:25:223
201749992118,2cyclictest263673-21kworker/u8:4+events_unbound20:18:543
201741992116,3cyclictest414541-21kworker/u8:0+flush-259:023:10:171
201741992115,4cyclictest425209-21/usr/sbin/munin22:45:171
201739992118,2cyclictest289521-21kworker/u8:3+events_unbound20:50:170
201739992118,2cyclictest263673-21kworker/u8:4+events_unbound20:10:230
201739992117,3cyclictest289473-21kworker/u8:2+events_unbound21:01:550
201749992015,3cyclictest335557-21systemd-journal20:24:523
201744992017,2cyclictest0-21swapper/220:25:002
20174199205,7cyclictest253726-21basename20:00:001
201741992017,2cyclictest420501-21irqcore22:40:161
201741992015,3cyclictest347371-21/usr/sbin/munin21:30:211
201741992014,4cyclictest335557-21systemd-journal00:18:011
201749991917,2cyclictest278461-21kworker/u8:1+events_unbound20:25:273
201749991916,2cyclictest435528-21kworker/u8:4+events_unbound23:21:153
20174499192,5cyclictest418962-21ntpq22:35:192
201744991914,4cyclictest357724-21apt-get21:40:102
201741991916,2cyclictest435528-21kworker/u8:4+flush-259:023:55:001
201741991912,5cyclictest535206-21/usr/sbin/munin00:30:141
201739991916,2cyclictest258748-21kworker/u8:2+events_unbound20:06:040
201739991916,2cyclictest227690-21kworker/u8:0+flush-259:019:35:170
201739991914,4cyclictest435528-21kworker/u8:4+flush-259:022:55:180
201739991914,2cyclictest435528-21kworker/u8:4+events_unbound23:40:140
201749991816,2cyclictest367815-21kworker/u8:1+events_unbound21:57:543
201749991816,1cyclictest524650-21kworker/u8:0+events_unbound00:28:553
201749991816,1cyclictest435528-21kworker/u8:4+events_unbound22:56:373
201749991815,2cyclictest534776-21kworker/u8:2+events_unbound00:34:563
201749991815,2cyclictest524650-21kworker/u8:0+events_unbound00:21:293
201749991814,3cyclictest441091-21rred23:00:013
201744991815,2cyclictest2971-21cron22:15:012
201741991816,1cyclictest0-21swapper/123:40:001
201741991814,2cyclictest357374-21kworker/u8:3+flush-259:022:15:241
201741991812,4cyclictest335557-21systemd-journal00:05:011
201739991814,3cyclictest258839-21idleruntime-cro20:04:590
201739991813,2cyclictest498638-21kworker/u8:3+events_unbound00:25:170
201749991715,1cyclictest0-21swapper/319:25:003
201749991714,2cyclictest487796-21kworker/u8:2+events_unbound23:43:033
201749991714,2cyclictest435528-21kworker/u8:4+events_unbound23:28:223
201749991714,2cyclictest289473-21kworker/u8:2+events_unbound20:46:583
201749991713,3cyclictest357374-21kworker/u8:3+flush-259:021:40:243
201749991713,1cyclictest191rcu_preempt23:15:003
20174499174,4cyclictest513482-21ntpq00:05:252
20174499173,5cyclictest293919-21/usr/sbin/munin20:35:192
20174499173,4cyclictest299280-21ntpq20:40:212
20174499172,9cyclictest435100-21taskset22:52:452
20174499172,6cyclictest539259-21gcc00:30:212
20174499172,6cyclictest451878-21/usr/sbin/munin23:10:152
20174499172,4cyclictest466031-21ntpq23:20:222
201744991712,4cyclictest238279-21latency_hist19:45:012
201744991712,3cyclictest398972-21/usr/sbin/munin22:20:192
201744991711,4cyclictest335557-21systemd-journal20:15:532
201741991713,3cyclictest357374-21kworker/u8:3+flush-259:021:50:241
201741991712,3cyclictest331682-21kworker/u8:0+flush-259:021:20:171
201739991714,2cyclictest524650-21kworker/u8:0+flush-259:000:35:190
201739991714,2cyclictest383907-21kworker/u8:0+flush-259:022:15:250
20174999167,1cyclictest0-21swapper/320:05:223
20174999162,3cyclictest50-21ksoftirqd/322:45:003
201749991614,2cyclictest263673-21kworker/u8:4+events_unbound20:13:223
201749991613,2cyclictest477640-21kworker/u8:1+events_unbound23:56:233
201749991613,2cyclictest477640-21kworker/u8:1+events_unbound00:07:353
201749991613,2cyclictest383907-21kworker/u8:0+events_unbound22:15:073
201749991613,2cyclictest289521-21kworker/u8:3+events_unbound21:11:433
201749991613,2cyclictest289473-21kworker/u8:2+events_unbound20:38:223
201749991613,2cyclictest142479-21kworker/u8:1+events_unbound19:17:483
201749991612,1cyclictest191rcu_preempt21:15:143
20174499164,2cyclictest450433-21ntpq23:05:242
20174499163,7cyclictest494478-21irqstats23:50:192
20174499162,9cyclictest414465-21taskset22:33:022
20174499162,5cyclictest326421-21taskset21:09:592
20174499162,5cyclictest313083-21cut20:55:202
20174499161,9cyclictest545000-21chrt00:36:052
201744991613,2cyclictest414541-21kworker/u8:0+flush-259:022:40:162
201741991613,2cyclictest446113-21turbostat23:05:001
201741991612,3cyclictest290088-21apt-get20:35:121
201739991613,2cyclictest216832-21kworker/u8:3+events_unbound19:40:120
20174999159,1cyclictest0-21swapper/322:35:203
20174999156,2cyclictest50-21ksoftirqd/319:35:203
201749991513,2cyclictest383907-21kworker/u8:0+events_unbound22:10:103
201749991512,2cyclictest414541-21kworker/u8:0+events_unbound23:38:473
201749991512,2cyclictest414541-21kworker/u8:0+events_unbound23:19:223
201749991512,2cyclictest414541-21kworker/u8:0+events_unbound22:50:063
201749991512,2cyclictest289521-21kworker/u8:3+events_unbound20:58:453
201749991512,2cyclictest201258-21kworker/u8:2+events_unbound19:30:433
201749991512,2cyclictest201258-21kworker/u8:2+events_unbound19:14:333
201749991511,2cyclictest289521-21kworker/u8:3+events_unbound20:51:463
201749991510,1cyclictest191rcu_preempt22:34:223
20174499153,2cyclictest534056-21ntpq00:25:222
20174499152,5cyclictest493001-21taskset23:47:212
20174499151,6cyclictest524281-21seq00:15:562
201744991511,3cyclictest316127-21kworker/u8:1+flush-259:021:05:002
20174199159,4cyclictest0-21swapper/120:30:001
20174199158,5cyclictest335557-21systemd-journal21:41:531
201741991513,1cyclictest378094-21latency_hist22:00:011
201741991511,3cyclictest201258-21kworker/u8:2+flush-259:019:30:241
201741991510,4cyclictest300443-21apt-get20:45:131
20174999148,1cyclictest0-21swapper/300:35:163
20174999144,5cyclictest325574-21ntpq21:05:223
20174999142,6cyclictest50-21ksoftirqd/320:30:183
201749991411,2cyclictest522052-21tr00:15:203
201749991411,2cyclictest491ktimers/319:45:243
201749991411,2cyclictest481rcuc/300:00:213
201749991411,2cyclictest477167-21unixbench_multi23:30:263
20174499148,4cyclictest233105-21latency_hist19:40:002
20174499143,2cyclictest518623-21ntpq00:10:212
20174499142,4cyclictest477527-21modprobe23:34:012
20174499142,4cyclictest242993-21/usr/sbin/munin19:45:282
201744991410,3cyclictest467489-21gpgv23:25:012
20174199149,3cyclictest435538-21/usr/sbin/munin22:55:241
20174199148,4cyclictest488273-21/usr/sbin/munin23:45:171
20174199148,4cyclictest342002-21kworker/u8:2+flush-259:021:45:261
20174199146,6cyclictest513-21gdbus23:10:001
201741991411,2cyclictest256255-21kthreadcore20:00:161
201739991412,1cyclictest60350irq/132-enp0s29f1:rx-023:05:190
20174999136,1cyclictest191rcu_preempt21:35:213
20174999131,2cyclictest492336-21ntpq23:45:233
20174499139,3cyclictest249026-21fschecks_time19:55:142
20174499139,3cyclictest0-21swapper/222:15:272
20174499139,2cyclictest0-21swapper/221:20:152
20174499136,5cyclictest441015-21base6423:00:012
20174499132,2cyclictest331649-21munin-run21:15:012
20174499132,2cyclictest211833-21runrttasks19:17:522
20174499132,2cyclictest206013-21ntpq19:10:252
20174499131,5cyclictest269000-21seq20:12:452
20174499131,3cyclictest528918-21ntpq00:20:222
20174499130,4cyclictest356578-21ld21:35:212
20174199139,2cyclictest0-21swapper/122:15:011
20174199138,3cyclictest289521-21kworker/u8:3+flush-259:020:50:201
20174199138,3cyclictest233106-21awk19:39:591
201741991310,2cyclictest515002-21grep00:10:151
201741991310,2cyclictest0-21swapper/121:00:161
20174999124,1cyclictest191rcu_preempt22:00:153
20174499129,2cyclictest414541-21kworker/u8:0+flush-259:022:45:202
20174499129,2cyclictest300701-21fschecks_time20:45:152
20174499128,3cyclictest217172-21apt19:24:592
20174499125,5cyclictest248532-21sh19:54:592
20174499124,6cyclictest478146-21perl23:35:152
20174499123,6cyclictest0-21swapper/220:50:242
20174499122,7cyclictest383457-21cat22:05:012
20174499121,2cyclictest288743-21memory20:30:182
20174199129,2cyclictest500-21systemd-logind22:40:001
20174199126,4cyclictest435528-21kworker/u8:4+events_unbound23:20:181
20174499118,2cyclictest375499-21tr21:55:192
20174499110,6cyclictest41-21ksoftirqd/221:45:242
20174199119,1cyclictest0-21swapper/120:10:141
20174199116,4cyclictest357374-21kworker/u8:3+flush-259:022:05:241
20174199116,3cyclictest332085-21cut21:15:171
20174199111,2cyclictest238279-21latency_hist19:45:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional