You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-28 - 08:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Sun Dec 28, 2025 00:43:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
27051991918,1cyclictest65850irq/126-lan19:55:150
27051991918,1cyclictest65850irq/126-lan19:10:150
27051991917,2cyclictest65850irq/126-lan20:59:540
27051991917,2cyclictest65850irq/126-lan19:40:130
27051991817,1cyclictest65850irq/126-lan22:05:000
27051991816,2cyclictest65850irq/126-lan22:35:130
27051991816,2cyclictest65850irq/126-lan00:35:130
27051991816,2cyclictest65850irq/126-lan00:05:230
27051991717,0cyclictest65850irq/126-lan23:40:200
27051991717,0cyclictest65850irq/126-lan20:15:120
27051991717,0cyclictest65850irq/126-lan19:45:340
27051991716,1cyclictest65850irq/126-lan23:50:120
27051991716,1cyclictest65850irq/126-lan23:45:180
27051991716,1cyclictest65850irq/126-lan23:30:180
27051991716,1cyclictest65850irq/126-lan23:25:160
27051991716,1cyclictest65850irq/126-lan23:15:180
27051991716,1cyclictest65850irq/126-lan23:10:130
27051991716,1cyclictest65850irq/126-lan22:15:180
27051991716,1cyclictest65850irq/126-lan21:30:180
27051991716,1cyclictest65850irq/126-lan21:20:240
27051991716,1cyclictest65850irq/126-lan20:40:130
27051991716,1cyclictest65850irq/126-lan19:25:120
27051991616,0cyclictest65850irq/126-lan23:35:120
27051991616,0cyclictest65850irq/126-lan00:18:520
27051991615,1cyclictest65850irq/126-lan22:50:190
27051991615,1cyclictest65850irq/126-lan21:35:230
27051991615,1cyclictest65850irq/126-lan20:50:000
27051991615,1cyclictest65850irq/126-lan20:21:590
27051991614,2cyclictest65850irq/126-lan21:05:120
27051991614,2cyclictest65850irq/126-lan19:30:160
27051991612,1cyclictest65850irq/126-lan21:40:160
27051991515,0cyclictest65850irq/126-lan20:05:180
27051991515,0cyclictest65850irq/126-lan20:00:210
27051991515,0cyclictest65850irq/126-lan00:30:200
27051991514,1cyclictest65850irq/126-lan22:25:180
27051991514,1cyclictest65850irq/126-lan21:25:170
27051991513,0cyclictest65850irq/126-lan20:10:160
27051991414,0cyclictest65850irq/126-lan21:10:120
27051991413,1cyclictest65850irq/126-lan23:01:220
27051991413,1cyclictest65850irq/126-lan22:40:180
27051991413,1cyclictest65850irq/126-lan19:15:180
27051991313,0cyclictest65850irq/126-lan22:55:150
27051991313,0cyclictest65850irq/126-lan22:10:140
27051991313,0cyclictest65850irq/126-lan20:35:210
27051991312,1cyclictest65850irq/126-lan23:20:190
27051991312,1cyclictest65850irq/126-lan23:05:210
27051991312,1cyclictest65850irq/126-lan22:45:120
27051991312,1cyclictest65850irq/126-lan00:20:200
27051991212,0cyclictest65850irq/126-lan23:55:160
27051991212,0cyclictest65850irq/126-lan22:20:160
27051991212,0cyclictest65850irq/126-lan21:52:220
27051991212,0cyclictest65850irq/126-lan20:25:180
27051991212,0cyclictest65850irq/126-lan19:20:140
27051991211,1cyclictest65850irq/126-lan21:15:140
27051991211,1cyclictest65850irq/126-lan20:30:160
27051991211,1cyclictest65850irq/126-lan00:00:180
27051991111,0cyclictest65850irq/126-lan21:57:340
27051991111,0cyclictest65850irq/126-lan19:35:120
27051991111,0cyclictest65850irq/126-lan00:10:160
27051991110,1cyclictest65850irq/126-lan22:30:160
27051991110,1cyclictest65850irq/126-lan21:45:230
27051991110,1cyclictest65850irq/126-lan20:53:210
27051991110,1cyclictest65850irq/126-lan00:25:120
2705199109,1cyclictest65850irq/126-lan22:00:150
27051991010,0cyclictest65850irq/126-lan21:00:190
270649998,1cyclictest743-21snmpd22:15:593
270599998,1cyclictest743-21snmpd23:52:062
270599998,1cyclictest743-21snmpd23:11:252
270569998,1cyclictest743-21snmpd20:29:401
270569998,1cyclictest13388-21gltestperf19:55:141
270519999,0cyclictest65850irq/126-lan19:51:210
270649988,0cyclictest743-21snmpd23:04:133
270649988,0cyclictest743-21snmpd22:50:043
270649988,0cyclictest743-21snmpd22:22:153
270649988,0cyclictest743-21snmpd21:58:493
270649988,0cyclictest743-21snmpd21:51:083
270649988,0cyclictest743-21snmpd21:01:543
270649988,0cyclictest743-21snmpd20:11:243
270649988,0cyclictest743-21snmpd19:55:553
270649988,0cyclictest743-21snmpd19:47:143
270649988,0cyclictest741-21lldpd23:12:213
270649988,0cyclictest741-21lldpd20:34:553
270649988,0cyclictest741-21lldpd00:12:463
270649987,1cyclictest743-21snmpd23:50:383
270649987,1cyclictest743-21snmpd21:16:273
270649987,1cyclictest743-21snmpd20:51:063
270649987,1cyclictest522-21avahi-daemon23:47:233
270649987,1cyclictest4115-21idleruntime-cro23:30:003
270649986,2cyclictest6827-21cat23:35:133
270599988,0cyclictest743-21snmpd23:16:442
270599988,0cyclictest743-21snmpd22:32:592
270599988,0cyclictest743-21snmpd00:25:272
270599988,0cyclictest741-21lldpd23:02:452
270599988,0cyclictest741-21lldpd20:38:432
270599988,0cyclictest741-21lldpd19:33:132
270599988,0cyclictest741-21lldpd00:17:382
270599987,1cyclictest743-21snmpd23:48:512
270599987,1cyclictest743-21snmpd22:08:322
270599987,1cyclictest3678-21kworker/2:1+events_freezable_pwr_efficient21:54:272
270599987,1cyclictest3678-21kworker/2:1+events_freezable_pwr_efficient21:43:282
270599987,1cyclictest3678-21kworker/2:1+events_freezable_pwr_efficient21:32:282
270599987,1cyclictest3678-21kworker/2:1+events_freezable_pwr_efficient00:39:122
270599987,1cyclictest3678-21kworker/2:1+events_freezable_pwr_efficient00:06:152
270599987,0cyclictest191rcu_preempt22:54:172
270599986,2cyclictest743-21snmpd22:39:032
270599986,2cyclictest743-21snmpd21:20:342
270599986,2cyclictest743-21snmpd00:24:462
270599986,2cyclictest743-21snmpd00:04:272
270599984,1cyclictest191rcu_preempt22:01:592
270569988,0cyclictest741-21lldpd22:06:411
270569988,0cyclictest741-21lldpd22:01:081
270569988,0cyclictest741-21lldpd20:33:271
270569988,0cyclictest741-21lldpd19:22:171
270569987,1cyclictest743-21snmpd23:49:061
270569987,1cyclictest743-21snmpd00:22:251
270569987,1cyclictest741-21lldpd00:06:141
270569987,1cyclictest4665-21cron19:35:011
270569987,1cyclictest14290-21cut22:35:011
270569986,2cyclictest743-21snmpd22:20:171
270569986,2cyclictest743-21snmpd22:14:261
270569986,2cyclictest743-21snmpd20:17:581
270569986,2cyclictest743-21snmpd19:37:261
270569986,2cyclictest743-21snmpd00:35:431
270569986,2cyclictest743-21snmpd00:14:211
270569986,2cyclictest24761-21cat21:40:141
270569985,3cyclictest17028-21cat22:40:161
270649977,0cyclictest743-21snmpd19:27:033
270649977,0cyclictest741-21lldpd22:41:533
270649977,0cyclictest741-21lldpd21:25:573
270649977,0cyclictest741-21lldpd20:58:513
270649976,1cyclictest743-21snmpd23:57:243
270649976,1cyclictest743-21snmpd21:32:283
270649976,1cyclictest743-21snmpd20:42:373
270649976,1cyclictest743-21snmpd00:07:543
270649976,1cyclictest522-21avahi-daemon21:21:273
270649976,1cyclictest17448-21gltestperf20:05:163
270649975,2cyclictest743-21snmpd22:48:093
270649975,2cyclictest743-21snmpd22:01:313
270649975,2cyclictest743-21snmpd00:19:133
270649974,3cyclictest16326-21sendmail22:40:013
270599977,0cyclictest741-21lldpd23:30:422
270599977,0cyclictest741-21lldpd21:45:432
270599977,0cyclictest741-21lldpd20:41:522
270599977,0cyclictest741-21lldpd20:34:372
270599977,0cyclictest741-21lldpd20:22:262
270599976,1cyclictest743-21snmpd23:29:532
270599976,1cyclictest743-21snmpd21:59:232
270599976,1cyclictest741-21lldpd19:55:372
270599976,1cyclictest3678-21kworker/2:1+events_freezable_pwr_efficient23:55:152
270599976,1cyclictest3678-21kworker/2:1+events_freezable_pwr_efficient23:44:172
270599976,1cyclictest3678-21kworker/2:1+events_freezable_pwr_efficient22:49:212
270599976,1cyclictest3678-21kworker/2:1+events_freezable_pwr_efficient22:27:242
270599976,1cyclictest3678-21kworker/2:1+events_freezable_pwr_efficient21:10:302
270599976,1cyclictest3678-21kworker/2:1+events_freezable_pwr_efficient20:48:332
270599976,1cyclictest3678-21kworker/2:1+events_freezable_pwr_efficient20:26:352
270599976,1cyclictest3678-21kworker/2:1+events_freezable_pwr_efficient20:15:372
270599976,1cyclictest3678-21kworker/2:1+events_freezable_pwr_efficient19:42:402
270599975,2cyclictest743-21snmpd23:24:462
270599975,2cyclictest743-21snmpd20:07:152
270599975,2cyclictest743-21snmpd19:51:032
270599974,2cyclictest743-21snmpd19:20:142
270599974,1cyclictest191rcu_preempt21:00:172
270599972,2cyclictest244-20systemd-journal21:37:332
270599971,3cyclictest43-21ksoftirqd/222:15:182
270599971,3cyclictest0-21swapper/220:55:172
270569977,0cyclictest743-21snmpd20:00:371
270569977,0cyclictest741-21lldpd21:59:141
270569977,0cyclictest741-21lldpd21:54:581
270569977,0cyclictest741-21lldpd21:13:121
270569977,0cyclictest741-21lldpd00:00:421
270569976,1cyclictest743-21snmpd21:05:391
270569976,1cyclictest743-21snmpd20:41:251
270569976,1cyclictest743-21snmpd20:21:141
270569976,1cyclictest743-21snmpd19:10:351
270569976,1cyclictest741-21lldpd19:28:561
270569976,1cyclictest506-21systemd-resolve23:05:011
270569975,2cyclictest743-21snmpd23:36:321
270569975,2cyclictest743-21snmpd23:24:011
270569975,2cyclictest743-21snmpd21:19:151
270569975,2cyclictest743-21snmpd20:09:151
270569975,2cyclictest743-21snmpd19:50:271
270569975,2cyclictest743-21snmpd19:42:031
270569975,2cyclictest29617-21cat20:35:161
270649966,0cyclictest743-21snmpd20:24:013
270649966,0cyclictest743-21snmpd20:17:103
270649966,0cyclictest741-21lldpd23:06:283
270649966,0cyclictest741-21lldpd22:26:253
270649966,0cyclictest741-21lldpd21:38:463
270649966,0cyclictest741-21lldpd19:53:523
270649966,0cyclictest741-21lldpd19:38:433
270649966,0cyclictest575-21rs:main3
270649966,0cyclictest506-21systemd-resolve20:38:193
270649965,1cyclictest741-21lldpd22:56:133
270649964,2cyclictest743-21snmpd20:49:273
270649964,2cyclictest743-21snmpd19:30:383
270649964,2cyclictest743-21snmpd19:22:533
270649963,3cyclictest30861-21diskstats23:15:143
270649962,4cyclictest14345-21cat22:35:003
270649962,3cyclictest25871-21ntp_states00:20:173
270649960,3cyclictest26238-21cat21:45:003
270599966,0cyclictest743-21snmpd22:13:592
270599966,0cyclictest522-21avahi-daemon20:51:552
270599965,1cyclictest743-21snmpd22:21:242
270599965,1cyclictest26734-21cpuspeed_turbos23:05:112
270599965,0cyclictest191rcu_preempt22:43:512
270599965,0cyclictest191rcu_preempt21:06:232
270599965,0cyclictest191rcu_preempt19:26:302
270599965,0cyclictest191rcu_preempt00:13:212
270599964,2cyclictest743-21snmpd20:01:042
270599964,0cyclictest191rcu_preempt19:36:052
270599963,1cyclictest191rcu_preempt22:55:162
270599962,3cyclictest0-21swapper/219:10:142
270599961,3cyclictest24695-21kworker/u16:3-events_unbound19:15:192
270599960,4cyclictest43-21ksoftirqd/221:25:172
270599960,4cyclictest43-21ksoftirqd/219:45:182
270599960,3cyclictest43-21ksoftirqd/223:39:592
270569966,0cyclictest741-21lldpd23:26:581
270569966,0cyclictest741-21lldpd21:24:501
270569966,0cyclictest741-21lldpd20:54:281
270569965,1cyclictest743-21snmpd22:59:581
270569965,1cyclictest743-21snmpd20:47:101
270569965,1cyclictest743-21snmpd19:45:061
270569965,1cyclictest741-21lldpd19:19:511
270569964,2cyclictest743-21snmpd22:45:581
270569964,2cyclictest743-21snmpd21:47:311
270569963,3cyclictest20565-21fw_packets21:30:141
270569963,2cyclictest5543-21sort20:55:141
270569962,3cyclictest30031-21users23:10:201
270569962,3cyclictest244-20systemd-journal23:16:131
270569961,5cyclictest557-21NetworkManager22:50:311
270649955,0cyclictest27042-21cyclictest19:15:193
270649954,1cyclictest743-21snmpd23:30:443
270649954,1cyclictest2388-21gltestperf22:05:153
270649952,3cyclictest557-21NetworkManager20:27:193
270649952,3cyclictest557-21NetworkManager00:29:403
270649952,2cyclictest5078-21ls22:10:213
270649952,2cyclictest244-20systemd-journal21:45:143
270649952,2cyclictest244-20systemd-journal20:03:443
270649951,4cyclictest29052-21cat19:15:013
270649950,4cyclictest31907-21ntpq00:35:183
270599953,2cyclictest14643-21cat21:15:132
270599953,0cyclictest191rcu_preempt20:11:052
270599950,3cyclictest43-21ksoftirqd/200:30:192
270569955,0cyclictest743-21snmpd21:37:011
270569955,0cyclictest741-21lldpd23:56:551
270569955,0cyclictest506-21systemd-resolve22:37:091
270569954,1cyclictest27791-21ntpq00:25:171
270569954,1cyclictest13121-21cut23:50:151
270569953,2cyclictest743-21snmpd23:42:021
270569953,2cyclictest743-21snmpd23:33:081
270569953,2cyclictest30805-21cron00:35:001
270569952,3cyclictest7599-21fw_conntrack21:00:141
270569952,3cyclictest557-21NetworkManager22:25:361
270569951,3cyclictest18863-21sed21:25:161
270569950,4cyclictest19864-21ntpq20:10:181
270649944,0cyclictest0-21swapper/319:43:563
270649942,2cyclictest8992-21wc23:40:163
270649941,2cyclictest29262-21grep00:30:133
270649940,3cyclictest618-21/usr/sbin/munin23:20:123
270649940,3cyclictest11474-21taskset21:09:533
270569942,2cyclictest743-21snmpd00:15:041
270569941,3cyclictest557-21NetworkManager23:00:041
270569941,2cyclictest6537-21cpuspeed_turbos22:15:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional