You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-16 - 21:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Thu Jul 16, 2026 12:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4168003994842,4cyclictest4173485-21cp07:15:001
4168000993832,4cyclictest313211-21diskstats12:35:130
4168007993733,3cyclictest335557-21systemd-journal10:40:442
4168007993732,4cyclictest188415-21latency_hist10:35:012
4168007993732,3cyclictest94622-21kworker/u8:2+flush-259:009:25:152
4168007993731,4cyclictest307198-21latency_hist12:30:012
4168007993730,5cyclictest271448-21diskstats11:55:132
4168003993633,2cyclictest94622-21kworker/u8:2+events_unbound11:15:231
4168003993633,2cyclictest4168179-21kworker/u8:0+events_unbound07:52:341
4168003993633,2cyclictest214261-21kworker/u8:3+flush-259:012:00:151
4168003993631,3cyclictest68986-21/usr/sbin/munin08:40:151
4168003993629,5cyclictest166300-21ntpq10:10:221
4168003993532,2cyclictest4184325-21kworker/u8:3+flush-259:008:15:261
4168003993531,3cyclictest52841-21kworker/u8:0+flush-259:008:35:151
4168000993528,5cyclictest68742-21latency_hist08:40:000
4168007993431,2cyclictest120631-21kworker/u8:3+flush-259:009:40:002
4168011993326,5cyclictest335557-21systemd-journal10:20:013
4168007993327,4cyclictest182367-21ntpq10:25:232
4168003993330,2cyclictest63443-21kworker/u8:1+events_unbound08:50:191
4168003993330,2cyclictest214261-21kworker/u8:3+events_unbound11:10:181
4168003993329,3cyclictest94622-21kworker/u8:2+events_unbound10:50:211
4168003993229,2cyclictest4168179-21kworker/u8:0+flush-259:007:25:161
4168003993229,2cyclictest4114332-21kworker/u8:2+events_unbound07:30:131
4168003993229,2cyclictest214261-21kworker/u8:3+events_unbound11:30:181
4168003993228,3cyclictest4184325-21kworker/u8:3+events_unbound08:20:211
4168000993228,3cyclictest4168179-21kworker/u8:0+flush-259:007:35:010
4168000993226,4cyclictest335557-21systemd-journal10:05:000
4168007993127,3cyclictest26612-21kworker/u8:2+events_unbound08:30:242
4168007993126,3cyclictest4173287-21base6407:15:012
4168003993128,2cyclictest5923-21kworker/u8:1+events_unbound07:45:221
4168003993128,2cyclictest52841-21kworker/u8:0+events_unbound09:05:181
4168003993128,2cyclictest52841-21kworker/u8:0+events_unbound08:45:221
4168003993128,2cyclictest4168179-21kworker/u8:0+flush-259:007:20:261
4168003993128,2cyclictest260329-21kworker/u8:1+flush-259:011:45:211
4168003993128,2cyclictest214261-21kworker/u8:3+flush-259:012:15:181
4168003993128,2cyclictest214261-21kworker/u8:3+events_unbound12:05:231
4168003993127,3cyclictest151870-21kworker/u8:3+flush-259:010:30:001
4168011993026,3cyclictest99884-21kworker/u8:1+flush-259:009:30:213
4168007993027,2cyclictest94622-21kworker/u8:2+flush-259:010:50:162
4168007993025,4cyclictest4184325-21kworker/u8:3+flush-259:008:25:012
4168000993025,4cyclictest63443-21kworker/u8:1+events_unbound08:50:170
4168011992922,5cyclictest98967-21ntpq09:05:213
4168007992925,3cyclictest151870-21kworker/u8:3+events_unbound10:35:252
4168003992927,2cyclictest229600-21kworker/u8:0+events_unbound11:55:231
4168003992926,2cyclictest52841-21kworker/u8:0+flush-259:009:15:161
4168003992926,2cyclictest4184325-21kworker/u8:3+flush-259:008:25:231
4168003992926,2cyclictest141259-21kworker/u8:1+flush-259:009:50:231
4168007992823,4cyclictest4184325-21kworker/u8:3+flush-259:008:25:212
4168007992823,3cyclictest229600-21kworker/u8:0+flush-259:011:35:212
4168003992824,3cyclictest260329-21kworker/u8:1+events_unbound11:50:111
4168000992823,4cyclictest84070-21kworker/u8:3+flush-259:008:55:240
4168007992724,2cyclictest94622-21kworker/u8:2+flush-259:010:45:242
4168007992724,2cyclictest214261-21kworker/u8:3+flush-259:012:10:272
4168007992724,2cyclictest141259-21kworker/u8:1+flush-259:009:50:212
4168007992723,3cyclictest94622-21kworker/u8:2+flush-259:011:00:202
4168007992723,3cyclictest4168179-21kworker/u8:0+events_unbound07:20:192
4168003992724,2cyclictest94622-21kworker/u8:2+events_unbound09:20:171
4168003992724,2cyclictest63443-21kworker/u8:1+events_unbound08:35:001
4168003992724,2cyclictest120631-21kworker/u8:3+flush-259:009:35:191
4168000992724,2cyclictest291710-21kworker/u8:0+flush-259:012:30:260
4168011992622,3cyclictest4162329-21kworker/u8:1+flush-259:007:15:263
4168007992623,2cyclictest4184325-21kworker/u8:3+flush-259:007:35:212
4168007992622,3cyclictest4162329-21kworker/u8:1+events_unbound07:15:222
4168003992623,2cyclictest94622-21kworker/u8:2+flush-259:010:30:241
4168003992623,2cyclictest229600-21kworker/u8:0+events_unbound11:40:151
4168003992623,2cyclictest229600-21kworker/u8:0+events_unbound11:40:141
4168003992623,2cyclictest214261-21kworker/u8:3+flush-259:011:05:261
4168003992623,2cyclictest214261-21kworker/u8:3+events_unbound12:10:201
4168000992622,3cyclictest151870-21kworker/u8:3+flush-259:010:05:280
4168000992621,4cyclictest178184-21gpgv10:25:010
4168011992521,3cyclictest47926-21apt-get08:20:123
4168011992521,3cyclictest214261-21kworker/u8:3+flush-259:011:05:163
4168011992520,3cyclictest214455-21/usr/sbin/munin11:00:133
4168011992517,6cyclictest67857-21ntpq08:35:213
4168007992522,2cyclictest214261-21kworker/u8:3+flush-259:011:25:252
4168007992521,3cyclictest94622-21kworker/u8:2+flush-259:009:20:152
4168007992521,3cyclictest214261-21kworker/u8:3+flush-259:011:30:522
4168007992520,3cyclictest509-21rs:main2
4168003992522,2cyclictest99884-21kworker/u8:1+events_unbound09:30:201
4168003992522,2cyclictest161987-21kworker/u8:5+events_unbound10:20:181
4168003992522,2cyclictest120631-21kworker/u8:3+flush-259:009:45:201
4168000992522,2cyclictest5923-21kworker/u8:1+flush-259:007:45:260
4168000992522,2cyclictest260329-21kworker/u8:1+flush-259:012:00:250
4168000992519,4cyclictest335557-21systemd-journal09:50:000
4168000992519,4cyclictest32189-21diskstats08:05:150
4168000992517,5cyclictest244364-21ntpq11:25:210
4168011992420,3cyclictest26612-21kworker/u8:2+flush-259:008:10:193
4168011992419,4cyclictest335557-21systemd-journal09:00:003
4168007992421,2cyclictest214261-21kworker/u8:3+events_unbound11:10:482
4168007992420,3cyclictest141259-21kworker/u8:1+flush-259:009:55:242
4168007992417,5cyclictest136505-21diskstats09:45:142
4168003992421,2cyclictest229600-21kworker/u8:0+events_unbound11:35:131
4168003992421,2cyclictest193604-21kworker/u8:1+events_unbound10:45:541
4168003992421,2cyclictest151870-21kworker/u8:3+events_unbound10:35:141
4168003992418,4cyclictest335557-21systemd-journal08:08:281
4168003992417,2cyclictest260329-21kworker/u8:1+events_unbound12:20:221
4168000992420,3cyclictest4162329-21kworker/u8:1+flush-259:007:10:230
4168000992420,3cyclictest151870-21kworker/u8:3+flush-259:010:10:240
4168000992420,3cyclictest141259-21kworker/u8:1+events_unbound09:55:180
4168000992418,4cyclictest335557-21systemd-journal10:50:290
4168000992418,4cyclictest16649-21diskstats07:50:120
4168000992417,5cyclictest171449-21ntpq10:15:190
4168011992320,2cyclictest63443-21kworker/u8:1+events_unbound08:40:183
4168007992320,2cyclictest94622-21kworker/u8:2+events_unbound09:10:152
4168007992320,2cyclictest52841-21kworker/u8:0+events_unbound09:15:322
4168003992320,2cyclictest5923-21kworker/u8:1+flush-259:007:40:191
4168003992319,3cyclictest120631-21kworker/u8:3+events_unbound09:40:181
4168000992320,2cyclictest84070-21kworker/u8:3+events_unbound09:00:220
4168000992319,3cyclictest4162329-21kworker/u8:1+events_unbound07:15:200
4168011992218,3cyclictest94622-21kworker/u8:2+flush-259:009:45:303
4168007992219,2cyclictest5923-21kworker/u8:1+events_unbound07:55:292
4168007992218,3cyclictest84070-21kworker/u8:3+events_unbound08:58:292
4168003992219,2cyclictest94622-21kworker/u8:2+events_unbound11:00:151
4168003992219,2cyclictest94622-21kworker/u8:2+events_unbound10:09:291
4168003992219,2cyclictest4168179-21kworker/u8:0+events_unbound07:39:301
4168003992219,2cyclictest193604-21kworker/u8:1+events_unbound10:40:151
4168003992218,3cyclictest94622-21kworker/u8:2+flush-259:009:05:011
4168003992218,3cyclictest183239-21kworker/u8:0+events_unbound10:55:181
4168003992217,3cyclictest151633-21sh10:00:011
4168003992215,5cyclictest235281-21diskstats11:20:141
4168000992219,2cyclictest183239-21kworker/u8:0+events_unbound11:01:280
4168000992218,3cyclictest214261-21kworker/u8:3+flush-259:011:05:220
4168000992215,5cyclictest296857-21latency_hist12:20:010
4168011992117,2cyclictest4184325-21kworker/u8:3+flush-259:008:00:233
4168011992116,3cyclictest209328-21apt-get10:55:123
4168011992115,4cyclictest270135-21ntpq11:50:193
4168007992118,2cyclictest4184325-21kworker/u8:3+events_unbound08:15:292
4168007992117,3cyclictest63443-21kworker/u8:1+flush-259:008:50:102
4168007992117,3cyclictest291710-21kworker/u8:0+events_unbound12:30:222
4168007992117,3cyclictest214261-21kworker/u8:3+events_unbound11:05:182
4168003992118,2cyclictest26612-21kworker/u8:2+events_unbound08:10:241
4168003992114,5cyclictest100283-21diskstats09:10:131
4168000992118,2cyclictest4184325-21kworker/u8:3+flush-259:008:20:210
4168000992117,3cyclictest94622-21kworker/u8:2+events_unbound10:33:300
4168000992117,3cyclictest94622-21kworker/u8:2+events_unbound09:35:000
4168000992117,3cyclictest130945-21kworker/u8:0+flush-259:009:40:270
4168000992116,3cyclictest973-21apt-get07:35:100
4168011992017,2cyclictest94622-21kworker/u8:2+flush-259:010:50:153
4168011992017,2cyclictest151632-21sh10:00:003
4168011992016,3cyclictest94622-21kworker/u8:2+flush-259:010:25:263
4168011992016,3cyclictest63443-21kworker/u8:1+flush-259:008:50:003
4168011992014,4cyclictest335557-21systemd-journal10:35:003
4168007992017,2cyclictest99884-21kworker/u8:1+events_unbound09:30:232
4168007992017,2cyclictest5923-21kworker/u8:1+events_unbound07:45:202
4168007992017,2cyclictest52841-21kworker/u8:0+events_unbound08:35:162
4168007992017,2cyclictest130945-21kworker/u8:0+flush-259:009:40:262
4168007992017,2cyclictest130945-21kworker/u8:0+events_unbound10:00:162
4168007992016,3cyclictest94622-21kworker/u8:2+flush-259:009:05:292
4168007992016,3cyclictest52841-21kworker/u8:0+flush-259:008:45:002
4168007992016,3cyclictest4114332-21kworker/u8:2+events_unbound07:29:192
4168007992013,5cyclictest697-21latency_hist07:35:012
4168003992017,2cyclictest99884-21kworker/u8:1+events_unbound09:26:281
4168003992017,2cyclictest291710-21kworker/u8:0+flush-259:012:25:271
4168003992017,2cyclictest214261-21kworker/u8:3+events_unbound11:25:131
4168003992016,3cyclictest5923-21kworker/u8:1+events_unbound07:55:271
4168000992017,2cyclictest94622-21kworker/u8:2+flush-259:009:25:240
4168000992016,3cyclictest4114332-21kworker/u8:2+events_unbound07:26:190
4168000992016,3cyclictest26612-21kworker/u8:2+flush-259:008:10:260
4168000992016,3cyclictest235085-21kworker/u8:1+events_unbound11:20:510
4168000992016,3cyclictest229600-21kworker/u8:0+flush-259:011:45:520
4168000992016,3cyclictest120631-21kworker/u8:3+events_unbound09:35:150
4168000992015,3cyclictest335480-21sshd10:39:280
4168011991915,3cyclictest94622-21kworker/u8:2+events_unbound09:05:003
4168007991916,2cyclictest4184325-21kworker/u8:3+flush-259:008:00:162
4168007991916,2cyclictest250411-21kworker/u8:2+events_unbound11:40:252
4168007991916,2cyclictest250411-21kworker/u8:2+events_unbound11:40:242
4168007991916,2cyclictest229600-21kworker/u8:0+events_unbound11:15:262
4168007991916,2cyclictest151870-21kworker/u8:3+flush-259:010:05:182
4168007991915,3cyclictest306856-21kworker/u8:3+events_unbound12:35:192
4168003991916,2cyclictest84070-21kworker/u8:3+events_unbound08:55:221
4168003991916,2cyclictest4184325-21kworker/u8:3+events_unbound08:00:131
4168003991916,2cyclictest291710-21kworker/u8:0+flush-259:012:30:251
4168000991915,3cyclictest260329-21kworker/u8:1+events_unbound12:20:300
4168000991915,3cyclictest229600-21kworker/u8:0+events_unbound11:40:170
4168000991915,3cyclictest229600-21kworker/u8:0+events_unbound11:40:160
4168007991815,2cyclictest94622-21kworker/u8:2+events_unbound10:11:292
4168007991815,2cyclictest260329-21kworker/u8:1+events_unbound12:17:292
4168007991814,3cyclictest151870-21kworker/u8:3+events_unbound10:15:482
4168000991814,3cyclictest4184325-21kworker/u8:3+events_unbound08:15:210
4168000991814,3cyclictest291710-21kworker/u8:0+flush-259:012:25:160
4168000991814,3cyclictest229600-21kworker/u8:0+events_unbound12:05:210
4168000991813,3cyclictest0-21swapper/010:50:000
4168011991714,2cyclictest0-21swapper/310:05:013
4168007991714,2cyclictest265916-21kworker/u8:2+flush-259:011:51:032
4168007991713,3cyclictest291710-21kworker/u8:0+events_unbound12:20:142
4168007991713,3cyclictest26612-21kworker/u8:2+events_unbound08:05:222
4168007991713,3cyclictest260329-21kworker/u8:1+events_unbound12:07:302
4168003991714,2cyclictest4178728-21cut07:20:011
4168003991713,3cyclictest94622-21kworker/u8:2+events_unbound10:04:531
4168003991713,3cyclictest306856-21kworker/u8:3+events_unbound12:35:131
4168000991714,2cyclictest250389-21systemd-run11:35:010
4168000991713,3cyclictest94622-21kworker/u8:2+events_unbound09:11:300
4168000991713,3cyclictest5923-21kworker/u8:1+events_unbound07:40:180
4168000991713,3cyclictest229600-21kworker/u8:0+events_unbound11:35:110
4168000991713,3cyclictest214261-21kworker/u8:3+events_unbound12:10:160
4168000991712,4cyclictest74209-21apt-get08:45:110
4168011991613,2cyclictest32439-21grep08:05:183
4168011991612,3cyclictest5923-21kworker/u8:1+flush-259:007:55:163
4168011991612,3cyclictest4168179-21kworker/u8:0+flush-259:007:50:203
4168011991612,3cyclictest214261-21kworker/u8:3+flush-259:012:15:233
4168007991613,2cyclictest5923-21kworker/u8:1+events_unbound07:40:202
4168007991613,2cyclictest260329-21kworker/u8:1+events_unbound12:00:192
4168007991612,3cyclictest84070-21kworker/u8:3+events_unbound09:00:182
4168007991612,3cyclictest509-21rs:main2
4168000991613,2cyclictest60350irq/132-enp0s29f1:rx-009:05:150
4168000991612,3cyclictest193604-21kworker/u8:1+events_unbound10:40:190
4168000991610,4cyclictest335557-21systemd-journal08:40:280
4168011991512,2cyclictest43192-21irqcore08:15:183
4168011991512,2cyclictest120631-21kworker/u8:3+flush-259:009:45:003
4168011991512,2cyclictest11736-21irqcore07:45:163
4168011991511,3cyclictest4162329-21kworker/u8:1+flush-259:007:10:263
4168007991512,2cyclictest229600-21kworker/u8:0+events_unbound11:48:282
4168003991512,2cyclictest151870-21kworker/u8:3+flush-259:010:15:231
4168000991513,1cyclictest60350irq/132-enp0s29f1:rx-011:19:150
4168000991513,1cyclictest60350irq/132-enp0s29f1:rx-010:20:250
4168000991513,1cyclictest60350irq/132-enp0s29f1:rx-008:30:190
4168000991512,2cyclictest60350irq/132-enp0s29f1:rx-009:17:520
4168000991511,3cyclictest5923-21kworker/u8:1+flush-259:007:55:260
4168000991511,3cyclictest265916-21kworker/u8:2+flush-259:011:50:210
4168000991511,3cyclictest183239-21kworker/u8:0+events_unbound10:55:160
4168000991510,4cyclictest94622-21kworker/u8:2+events_unbound11:15:000
4168000991510,3cyclictest57988-21apt-get08:30:000
416801199141,3cyclictest1778252store10:25:013
4168011991412,1cyclictest0-21swapper/312:25:013
4168011991411,2cyclictest63443-21kworker/u8:1+flush-259:008:50:213
4168011991411,2cyclictest4179838-21irqcore07:20:183
4168007991412,1cyclictest0-21swapper/208:15:012
4168007991411,2cyclictest173047-21irqcore10:20:162
4168007991410,3cyclictest52841-21kworker/u8:0+flush-259:008:46:432
416800099148,4cyclictest26827-21/usr/sbin/munin08:00:150
4168000991411,2cyclictest4168179-21kworker/u8:0+events_unbound07:20:230
4168000991410,3cyclictest99884-21kworker/u8:1+flush-259:009:20:390
4168000991410,3cyclictest141259-21kworker/u8:1+events_unbound09:54:300
416801199139,3cyclictest120631-21kworker/u8:3+flush-259:009:35:163
4168011991310,2cyclictest256826-21kthreadcore11:40:183
4168011991310,2cyclictest256826-21kthreadcore11:40:173
4168011991310,2cyclictest193604-21kworker/u8:1+events_unbound10:40:183
4168011991310,2cyclictest143813-21kthreadcore09:50:163
4168011991310,2cyclictest1054-21cpuspeed_turbos07:35:123
416800799139,3cyclictest235085-21kworker/u8:1+events_unbound11:23:152
416801199129,2cyclictest56426-21kthreadcore08:25:183
416801199129,2cyclictest193112-21unixbench_multi10:35:253
416801199127,4cyclictest235120-21apt-get11:20:123
4168011991212,0cyclictest911239-21kworker/3:2+events_power_efficient11:27:153
416801199118,2cyclictest0-21swapper/310:45:183
416801199116,4cyclictest260936-21apt-get11:45:113
416801199110,4cyclictest120760-21cat09:30:003
416801199107,2cyclictest224927-21cpuspeed_turbos11:10:143
416801199104,4cyclictest335557-21systemd-journal10:14:553
41680119996,1cyclictest0-21swapper/307:25:163
41680119995,3cyclictest491ktimers/311:15:113
41680119982,4cyclictest286475-21cron12:10:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional