You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-03 - 23:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Wed Jun 03, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
756272993834,3cyclictest793423-21kworker/u8:4+flush-259:007:50:000
756282993629,5cyclictest807893-21ntpq07:55:232
756272993629,5cyclictest980232-21cat10:45:010
756282993431,2cyclictest771149-21kworker/u8:1+flush-259:007:25:162
756282993428,4cyclictest1016779-21/usr/sbin/munin11:20:132
756278993430,3cyclictest829413-21gpgv08:20:001
756278993329,3cyclictest1026484-21kworker/u8:2+flush-259:011:50:001
756272993327,4cyclictest802668-21ntpq07:50:220
756272993326,5cyclictest1092980-21ntpq12:30:200
756287993229,2cyclictest985664-21kworker/u8:0+flush-259:012:20:163
756282993225,5cyclictest1099059-21latency_hist12:40:012
756282993127,3cyclictest830041-21kworker/u8:2+flush-259:009:19:592
756278993127,3cyclictest830041-21kworker/u8:2+flush-259:009:14:591
756272993125,4cyclictest1047862-21diskstats11:50:130
756287993025,4cyclictest968897-21ntpq10:30:213
756287992926,2cyclictest985664-21kworker/u8:0+events_unbound11:50:193
756282992924,3cyclictest985664-21kworker/u8:0+events_unbound11:40:222
756282992922,5cyclictest1031111-21ntpq11:30:202
756282992825,2cyclictest829384-21apt-get08:20:022
756282992824,3cyclictest735798-21kworker/u8:0+events_unbound08:10:192
756287992723,3cyclictest792254-21kworker/u8:1+events_unbound08:42:303
756282992721,4cyclictest974913-21latency_hist10:40:012
756278992723,3cyclictest954379-21kworker/u8:1+flush-259:012:25:171
756272992723,3cyclictest954379-21kworker/u8:1+flush-259:012:10:000
756287992623,3cyclictest985664-21kworker/u8:0+events_unbound10:50:233
756287992623,2cyclictest985664-21kworker/u8:0+events_unbound11:40:213
756287992623,2cyclictest830041-21kworker/u8:2+flush-259:008:45:253
756282992622,3cyclictest985664-21kworker/u8:0+events_unbound11:10:002
756282992620,4cyclictest1046539-21ntpq11:45:212
756278992621,4cyclictest954379-21kworker/u8:1+flush-259:011:40:001
756272992622,3cyclictest985901-21apt-get10:50:110
756287992522,2cyclictest861337-21kworker/u8:0+flush-259:008:55:223
756287992522,2cyclictest735798-21kworker/u8:0+flush-259:008:00:213
756287992521,3cyclictest808674-21kworker/u8:3+flush-259:008:25:003
756287992521,3cyclictest808674-21kworker/u8:3+events_unbound08:35:143
756287992521,2cyclictest792254-21kworker/u8:1+flush-259:008:25:243
756282992521,3cyclictest954379-21kworker/u8:1+events_unbound12:25:282
756278992521,3cyclictest908525-21kworker/u8:2+flush-259:010:15:251
756272992522,2cyclictest746214-21kworker/u8:3+flush-259:007:35:170
756287992421,3cyclictest760413-21kworker/u8:2+events_unbound07:10:313
756287992421,1cyclictest876997-21sh09:04:593
756287992420,3cyclictest335557-21systemd-journal09:51:293
756282992420,3cyclictest908525-21kworker/u8:2+events_unbound09:54:292
756282992420,3cyclictest746214-21kworker/u8:3+flush-259:007:35:212
756278992419,3cyclictest1094136-21/usr/sbin/munin12:35:141
756272992420,3cyclictest923600-21kworker/u8:4+flush-259:010:05:210
756272992420,3cyclictest1026484-21kworker/u8:2+events_unbound12:00:180
756272992420,3cyclictest1026484-21kworker/u8:2+events_unbound12:00:180
756272992417,5cyclictest922457-21ntpq09:45:180
756287992320,2cyclictest887305-21kworker/u8:1+flush-259:009:45:153
756287992319,3cyclictest908525-21kworker/u8:2+flush-259:010:10:003
756287992319,3cyclictest808674-21kworker/u8:3+events_unbound08:30:253
756287992319,3cyclictest792254-21kworker/u8:1+events_unbound07:49:293
756287992318,4cyclictest1068338-21apt-get12:10:133
756282992320,2cyclictest861337-21kworker/u8:0+flush-259:008:55:252
756282992319,3cyclictest938893-21kworker/u8:0+flush-259:010:15:212
756278992319,3cyclictest985664-21kworker/u8:0+flush-259:011:10:261
756278992318,3cyclictest954379-21kworker/u8:1+flush-259:012:05:011
756278992317,4cyclictest1037401-21/usr/sbin/munin11:40:141
756272992319,3cyclictest908525-21kworker/u8:2+flush-259:010:20:000
756272992317,4cyclictest897522-21kworker/u8:3+flush-259:009:25:180
756272992316,5cyclictest735798-21kworker/u8:0+flush-259:007:30:180
756287992219,2cyclictest985664-21kworker/u8:0+events_unbound11:30:183
756287992219,2cyclictest985664-21kworker/u8:0+events_unbound11:25:193
756287992219,2cyclictest861337-21kworker/u8:0+events_unbound09:20:163
756287992219,2cyclictest761401-21kworker/u8:4+flush-259:007:20:193
756287992219,2cyclictest735798-21kworker/u8:0+flush-259:007:50:153
756287992218,3cyclictest908525-21kworker/u8:2+flush-259:010:20:153
756287992218,3cyclictest877221-21kworker/u8:3+events_unbound09:05:233
756287992218,3cyclictest781742-21kworker/u8:2+events_unbound07:55:153
756282992218,3cyclictest954379-21kworker/u8:1+events_unbound11:58:312
756282992218,3cyclictest908525-21kworker/u8:2+events_unbound09:35:222
756282992218,3cyclictest830041-21kworker/u8:2+events_unbound08:40:232
756282992218,3cyclictest808674-21kworker/u8:3+events_unbound08:09:282
756282992218,3cyclictest735798-21kworker/u8:0+flush-259:007:30:262
756282992218,3cyclictest335557-21systemd-journal08:38:292
756282992215,5cyclictest840130-21latency_hist08:30:012
756287992118,3cyclictest985664-21kworker/u8:0+events_unbound11:00:023
756287992118,3cyclictest954379-21kworker/u8:1+events_unbound10:45:233
756287992118,2cyclictest985664-21kworker/u8:0+flush-259:011:20:313
756287992118,2cyclictest959742-21apt-get10:25:123
756287992118,2cyclictest887305-21kworker/u8:1+events_unbound09:30:153
756287992118,2cyclictest887305-21kworker/u8:1+events_unbound09:30:143
756282992117,3cyclictest985664-21kworker/u8:0+events_unbound11:04:592
756282992117,3cyclictest923361-21kworker/u8:3+events_unbound09:55:152
756282992117,3cyclictest908525-21kworker/u8:2+events_unbound10:20:132
756282992117,3cyclictest887305-21kworker/u8:1+events_unbound09:27:292
756278992116,4cyclictest771997-21apt-get07:25:121
756278992114,5cyclictest335557-21systemd-journal10:25:001
756272992118,2cyclictest907863-21sh09:35:000
756272992118,2cyclictest907863-21sh09:34:590
756272992116,3cyclictest335557-21systemd-journal08:25:290
756272992114,5cyclictest335557-21systemd-journal11:15:000
756287992017,2cyclictest808674-21kworker/u8:3+flush-259:008:05:193
756287992017,2cyclictest808674-21kworker/u8:3+events_unbound08:10:313
756287992017,2cyclictest781742-21kworker/u8:2+events_unbound07:40:163
756287992017,2cyclictest746214-21kworker/u8:3+flush-259:007:15:203
756287992017,2cyclictest746214-21kworker/u8:3+flush-259:007:15:203
756287992016,3cyclictest985664-21kworker/u8:0+events_unbound10:58:033
756287992016,2cyclictest746214-21kworker/u8:3+events_unbound07:35:173
756287992014,5cyclictest509-21rs:main3
756287992012,6cyclictest980055-21latency_hist10:45:013
756282992017,2cyclictest887305-21kworker/u8:1+events_unbound09:30:312
756282992017,2cyclictest887305-21kworker/u8:1+events_unbound09:30:312
756282992016,3cyclictest923600-21kworker/u8:4+flush-259:010:15:012
756282992016,3cyclictest746214-21kworker/u8:3+flush-259:007:15:302
756282992016,3cyclictest746214-21kworker/u8:3+flush-259:007:15:292
756278992014,4cyclictest786815-21ntpq07:35:221
756272992013,5cyclictest934161-21diskstats10:00:130
756287991916,2cyclictest985664-21kworker/u8:0+flush-259:011:10:253
756287991916,2cyclictest1026484-21kworker/u8:2+events_unbound12:00:203
756287991916,2cyclictest1026484-21kworker/u8:2+events_unbound12:00:203
756287991915,3cyclictest985664-21kworker/u8:0+flush-259:012:15:213
756287991913,4cyclictest335557-21systemd-journal09:40:003
756282991916,2cyclictest908525-21kworker/u8:2+events_unbound10:00:232
756282991915,3cyclictest985664-21kworker/u8:0+events_unbound12:10:192
756282991915,3cyclictest830041-21kworker/u8:2+events_unbound09:24:302
756282991915,3cyclictest830041-21kworker/u8:2+events_unbound09:02:292
756282991915,3cyclictest830041-21kworker/u8:2+events_unbound08:45:152
756282991915,3cyclictest746214-21kworker/u8:3+events_unbound07:12:312
756282991915,3cyclictest2971-21cron07:55:002
756282991914,4cyclictest781742-21kworker/u8:2+events_unbound07:42:312
756278991914,4cyclictest866868-21base6408:55:001
756278991913,4cyclictest335557-21systemd-journal10:02:281
756272991915,3cyclictest1083830-21kworker/u8:3+flush-259:012:35:100
756272991915,3cyclictest1026484-21kworker/u8:2+flush-259:011:45:200
756272991914,4cyclictest766866-21apt-get07:20:110
756287991814,2cyclictest913743-21irqcore09:40:163
756282991815,2cyclictest887305-21kworker/u8:1+events_unbound09:45:162
756282991814,3cyclictest908525-21kworker/u8:2+flush-259:010:46:332
756282991814,3cyclictest781742-21kworker/u8:2+events_unbound08:02:312
756282991814,3cyclictest1062949-21kworker/u8:3+events_unbound12:05:312
756278991813,4cyclictest908525-21kworker/u8:2+flush-259:009:35:231
756278991813,4cyclictest887305-21kworker/u8:1+flush-259:009:40:161
756272991814,3cyclictest819269-21kworker/u8:4+events_unbound08:15:000
756272991814,3cyclictest808674-21kworker/u8:3+events_unbound08:05:150
756272991812,5cyclictest845270-21apt-get08:35:020
756287991714,2cyclictest877221-21kworker/u8:3+events_unbound09:11:063
756287991714,2cyclictest792254-21kworker/u8:1+flush-259:008:50:203
756287991713,3cyclictest985664-21kworker/u8:0+events_unbound11:17:313
756287991713,3cyclictest954379-21kworker/u8:1+events_unbound12:25:183
756287991713,3cyclictest1083830-21kworker/u8:3+flush-259:012:35:203
756287991713,3cyclictest0-21swapper/312:35:003
756287991712,3cyclictest949437-21/usr/sbin/munin10:15:203
756282991714,2cyclictest985664-21kworker/u8:0+flush-259:011:50:212
756282991714,2cyclictest954379-21kworker/u8:1+events_unbound12:35:022
756282991714,2cyclictest507-21in:imuxsock11:00:012
756282991713,3cyclictest985664-21kworker/u8:0+events_unbound11:15:132
756282991713,3cyclictest792254-21kworker/u8:1+events_unbound08:50:282
756282991712,4cyclictest954379-21kworker/u8:1+events_unbound10:40:122
756278991713,2cyclictest929239-21irqcore09:55:171
756278991713,2cyclictest500-21systemd-logind08:10:011
756278991711,4cyclictest923369-21latency_hist09:50:011
756278991711,4cyclictest1026854-21latency_hist11:29:591
756278991710,5cyclictest1011707-21apt-get11:15:111
756272991714,2cyclictest60350irq/132-enp0s29f1:rx-009:35:110
756272991713,3cyclictest851096-21apt-get08:40:110
756287991613,2cyclictest923361-21kworker/u8:3+events_unbound09:55:213
756287991613,2cyclictest792254-21kworker/u8:1+events_unbound08:17:473
756278991612,3cyclictest335557-21systemd-journal10:44:541
756278991612,3cyclictest1026484-21kworker/u8:2+flush-259:012:00:261
756278991612,3cyclictest1026484-21kworker/u8:2+flush-259:012:00:251
756278991611,4cyclictest872093-21apt-get09:00:121
756272991614,1cyclictest60350irq/132-enp0s29f1:rx-009:15:260
756272991614,1cyclictest60350irq/132-enp0s29f1:rx-008:30:150
756272991613,2cyclictest60350irq/132-enp0s29f1:rx-011:35:180
756272991613,2cyclictest60350irq/132-enp0s29f1:rx-007:25:150
756272991613,2cyclictest0-21swapper/009:14:590
756272991612,3cyclictest985664-21kworker/u8:0+flush-259:012:20:210
756272991612,3cyclictest746214-21kworker/u8:3+flush-259:007:20:010
756272991612,3cyclictest746214-21kworker/u8:3+flush-259:007:20:000
756272991611,4cyclictest970040-21apt-get10:35:110
756272991611,4cyclictest1006486-21kworker/u8:4+flush-259:011:20:000
756272991610,4cyclictest985664-21kworker/u8:0+flush-259:011:00:170
756287991512,2cyclictest746214-21kworker/u8:3+events_unbound07:29:213
756287991511,3cyclictest781742-21kworker/u8:2+events_unbound07:32:413
756282991513,1cyclictest793423-21kworker/u8:4+events_unbound07:45:212
756282991513,1cyclictest0-21swapper/210:55:012
756282991512,3cyclictest877221-21kworker/u8:3+flush-259:009:05:212
756282991512,2cyclictest954379-21kworker/u8:1+flush-259:011:25:312
756282991511,3cyclictest908525-21kworker/u8:2+events_unbound10:30:252
756282991511,3cyclictest830041-21kworker/u8:2+events_unbound09:10:132
756282991511,3cyclictest792254-21kworker/u8:1+flush-259:008:30:202
75627899159,5cyclictest855143-21ntpq08:40:221
756278991511,3cyclictest861337-21kworker/u8:0+flush-259:009:20:231
756272991514,1cyclictest60350irq/132-enp0s29f1:rx-008:20:080
756272991513,1cyclictest60350irq/132-enp0s29f1:rx-012:28:300
756272991513,1cyclictest60350irq/132-enp0s29f1:rx-010:28:280
756272991513,1cyclictest60350irq/132-enp0s29f1:rx-007:10:150
756272991512,2cyclictest60350irq/132-enp0s29f1:rx-012:15:110
756272991512,2cyclictest60350irq/132-enp0s29f1:rx-009:50:180
756272991512,2cyclictest60350irq/132-enp0s29f1:rx-008:50:260
756272991512,2cyclictest60350irq/132-enp0s29f1:rx-008:49:540
756272991510,4cyclictest335557-21systemd-journal11:00:000
756287991411,2cyclictest887305-21kworker/u8:1+events_unbound09:26:293
756287991410,3cyclictest908525-21kworker/u8:2+events_unbound10:04:313
756287991410,2cyclictest0-21swapper/311:35:133
75628299148,4cyclictest335557-21systemd-journal12:20:002
756282991410,3cyclictest1057965-21/usr/sbin/munin12:00:142
756282991410,3cyclictest1057965-21/usr/sbin/munin12:00:142
756278991412,1cyclictest0-21swapper/108:55:001
756278991410,3cyclictest1073486-21kworker/u8:2+flush-259:012:20:171
756272991412,1cyclictest60350irq/132-enp0s29f1:rx-011:28:540
756272991412,1cyclictest60350irq/132-enp0s29f1:rx-011:20:240
756272991412,1cyclictest60350irq/132-enp0s29f1:rx-010:45:220
756272991412,1cyclictest60350irq/132-enp0s29f1:rx-009:05:200
756272991412,1cyclictest60350irq/132-enp0s29f1:rx-007:40:080
756272991411,2cyclictest60350irq/132-enp0s29f1:rx-011:55:350
756272991411,2cyclictest60350irq/132-enp0s29f1:rx-011:06:180
756272991411,2cyclictest60350irq/132-enp0s29f1:rx-010:20:260
756272991411,2cyclictest60350irq/132-enp0s29f1:rx-009:00:120
75628799139,3cyclictest1062949-21kworker/u8:3+events_unbound12:09:323
75628799138,4cyclictest985664-21kworker/u8:0+events_unbound11:09:323
756287991310,2cyclictest985664-21kworker/u8:0+events_unbound11:45:013
75628299139,3cyclictest985664-21kworker/u8:0+flush-259:011:37:352
75627899139,3cyclictest1021692-21cat11:24:551
75627899138,3cyclictest509-21rs:main1
75627899136,5cyclictest949207-21latency_hist10:15:011
756278991311,1cyclictest882145-21turbostat09:10:001
756278991310,2cyclictest0-21swapper/108:05:001
756272991311,2cyclictest60350irq/132-enp0s29f1:rx-007:59:300
756272991311,1cyclictest897563-21turbostat09:24:590
756272991311,1cyclictest60350irq/132-enp0s29f1:rx-008:15:200
756272991310,2cyclictest60350irq/132-enp0s29f1:rx-011:31:060
756272991310,2cyclictest60350irq/132-enp0s29f1:rx-010:11:510
756272991310,2cyclictest1041867-21unixbench_multi11:40:250
75628799126,4cyclictest335557-21systemd-journal12:00:003
75628299129,2cyclictest985664-21kworker/u8:0+flush-259:011:10:242
75628299129,2cyclictest902747-21kworker/u8:0+flush-259:009:44:352
75628299128,3cyclictest908525-21kworker/u8:2+events_unbound10:25:132
75628299128,3cyclictest735798-21kworker/u8:0+events_unbound08:16:292
756282991210,1cyclictest985664-21kworker/u8:0-ext4-rsv-conversion12:25:002
75627899129,2cyclictest980592-21apt-key10:45:001
75627899129,2cyclictest1048382-21irqcore11:50:151
75627899128,3cyclictest735798-21kworker/u8:0+flush-259:007:17:321
75627899128,3cyclictest735798-21kworker/u8:0+flush-259:007:17:311
75627899127,4cyclictest808716-21latency_hist08:00:011
756272991210,1cyclictest0-21swapper/010:35:010
75628799117,3cyclictest908525-21kworker/u8:2+events_unbound10:37:543
75628299117,3cyclictest771149-21kworker/u8:1+flush-259:007:20:282
75627899112,8cyclictest490-21dbus-daemon07:35:011
75627899106,3cyclictest954379-21kworker/u8:1+flush-259:011:05:061
75627899106,2cyclictest968908-21ntpq10:30:201
75627899100,3cyclictest974913-21latency_hist10:40:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional