You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-14 - 18:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot6s.osadl.org (updated Mon Sep 14, 2026 12:43:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
50379910511049,2cyclictest6009-21turbostat11:19:553
50379910511049,2cyclictest21191-21kworker/3:0+events09:26:273
50379910511048,3cyclictest18918-21kworker/3:2+events12:14:263
50209910501049,1cyclictest6814-21kworker/0:0+events10:51:070
50379910471045,2cyclictest9233-21kworker/3:2+events09:33:403
50339910471044,3cyclictest18280-21turbostat09:44:542
50379910461044,2cyclictest3599-21kworker/3:1+events10:24:053
50379910461044,2cyclictest32329-21kworker/3:1+events10:31:063
50209910461045,1cyclictest10956-21kworker/0:2+events09:48:030
50209910461044,2cyclictest1959-21kworker/0:1+events11:59:020
50379910441042,2cyclictest32329-21kworker/3:1+events12:05:223
50379910431041,2cyclictest28323-21kworker/3:1+events08:11:053
50379910431041,2cyclictest23775-21kworker/3:1+events09:12:443
50379910431041,2cyclictest21191-21kworker/3:0+events09:39:343
50379910431040,3cyclictest24180-21kworker/3:0+events11:41:063
50339910431042,1cyclictest18841-21kworker/2:1+events07:43:442
50379910421040,2cyclictest3599-21kworker/3:1+events10:03:303
50209910421040,2cyclictest1959-21kworker/0:1+events11:52:410
50379910411040,1cyclictest28323-21kworker/3:1+events08:07:513
50379910411039,2cyclictest6396-21kworker/3:0+events08:32:113
50379910411039,2cyclictest26509-21kworker/3:2+events10:36:513
50379910411037,3cyclictest26509-21kworker/3:2+events10:27:593
50379910401038,2cyclictest21191-21kworker/3:0+events09:22:433
50379910401038,2cyclictest14702-21kworker/3:2+events08:57:003
50379910391037,2cyclictest28323-21kworker/3:1+events08:17:023
50379910391036,3cyclictest21191-21kworker/3:0+events09:07:563
50379910381036,2cyclictest10495-21kworker/3:1+events08:39:003
50379910381035,3cyclictest26029-21kworker/3:0+events08:20:223
50209910371035,2cyclictest24233-21turbostat11:39:550
50379910361033,3cyclictest24180-21kworker/3:0+events11:39:143
50289910361033,3cyclictest4374-21turbostat12:29:541
50379910351033,2cyclictest30557-21kworker/3:2+events08:02:543
50379910351032,3cyclictest28323-21kworker/3:1+events08:26:523
50379910351032,3cyclictest23775-21kworker/3:1+events09:15:333
50379910341031,3cyclictest29968-21kworker/3:0+events12:21:063
50379910341031,3cyclictest14702-21kworker/3:2+events08:54:093
50379910331030,3cyclictest18918-21kworker/3:2+events12:28:103
50379910331030,3cyclictest18918-21kworker/3:2+events12:15:213
50209910301028,2cyclictest6814-21kworker/0:0+events10:58:410
50209910291029,0cyclictest6814-21kworker/0:0+events11:00:220
50289910261024,2cyclictest24036-21turbostat07:59:551
50209910231021,1cyclictest31620-21turbostat09:59:550
50209910221020,2cyclictest3406-21kworker/0:0+events11:16:510
50289910211017,2cyclictest14496-21turbostat12:04:551
50289910201019,1cyclictest9117-21kworker/1:1+events12:31:561
50339910181017,1cyclictest18841-21kworker/2:1+events11:21:062
50209910151014,1cyclictest1437-21kworker/0:1+events10:46:500
50339910141013,1cyclictest15022-21kworker/2:2+events07:26:062
50209910111010,1cyclictest17480-21kworker/0:0+events12:03:260
50209910111010,1cyclictest1437-21kworker/0:1+events11:12:440
50209910061005,1cyclictest10956-21kworker/0:2+events09:51:250
50289910021001,1cyclictest28701-21kworker/1:1+events07:14:541
50289910011000,1cyclictest18897-21kworker/1:1+events09:41:281
502899997996,1cyclictest12687-21kworker/1:0+events10:16:051
502899996995,1cyclictest19901-21kworker/1:0+events07:49:541
502899996995,1cyclictest10650-21kworker/1:1+events07:21:461
502899995994,1cyclictest8483-21kworker/1:2+events12:38:411
502099995994,1cyclictest6814-21kworker/0:0+events10:40:430
502099995994,1cyclictest19437-21kworker/0:0+events09:01:150
502899994993,1cyclictest8483-21kworker/1:2+events10:07:101
502899994993,1cyclictest20148-21kworker/1:0+events07:18:471
502099994993,1cyclictest8574-21kworker/0:2+events11:45:230
502099994993,1cyclictest10956-21kworker/0:2+events08:42:540
502099993992,1cyclictest29790-21kworker/0:2+events11:06:180
503399992989,3cyclictest30387-21turbostat10:34:552
502899992991,1cyclictest19901-21kworker/1:0+events07:52:011
503399990988,2cyclictest18841-21kworker/2:1+events11:31:492
503399989987,2cyclictest19188-21turbostat09:04:552
502899989988,1cyclictest8483-21kworker/1:2+events10:14:081
502899989988,1cyclictest25713-21kworker/1:2+events08:45:191
503399988986,2cyclictest15022-21kworker/2:2+events07:36:172
503799980978,2cyclictest5625-21turbostat11:54:553
502099967964,3cyclictest28096-21turbostat08:09:550
502899960957,3cyclictest6646-21turbostat08:34:551
502099958956,2cyclictest19812-21turbostat11:34:550
503399943942,1cyclictest11336-21kworker/2:2+events11:25:212
503799938936,2cyclictest9005-21turbostat07:24:553
503399934933,1cyclictest11005-21kworker/2:0+events07:31:462
503799931928,3cyclictest17124-21turbostat07:44:553
503799911909,2cyclictest10677-21turbostat08:44:553
502899900899,1cyclictest28684-21turbostat11:44:551
502099891890,1cyclictest17003-21turbostat10:19:550
503799865863,2cyclictest10900-21turbostat11:24:553
502099856855,1cyclictest3669-21turbostat10:04:550
503799681679,2cyclictest17003-21turbostat10:19:553
502099671667,3cyclictest28684-21turbostat11:44:550
502099663660,3cyclictest18280-21turbostat09:44:550
503799644640,3cyclictest19188-21turbostat09:04:543
502899639636,3cyclictest17124-21turbostat07:44:551
502899638634,3cyclictest13804-21turbostat09:39:551
503799627625,2cyclictest24036-21turbostat07:59:553
503799619617,2cyclictest14496-21turbostat12:04:553
502899618617,1cyclictest10677-21turbostat08:44:551
502099616615,1cyclictest8664-21turbostat08:39:550
503799613610,3cyclictest31620-21turbostat09:59:543
503399598594,4cyclictest9005-21turbostat07:24:552
503799549546,3cyclictest19812-21turbostat11:34:553
502099535533,2cyclictest2432-21turbostat10:39:550
502099534532,2cyclictest17164-21turbostat08:59:550
503799532531,1cyclictest12712-21turbostat08:49:553
503399508506,2cyclictest6009-21turbostat11:19:552
502899420419,1cyclictest3669-21turbostat10:04:551
5037991918,1cyclictest67750irq/123-lan11:45:153
5037991918,1cyclictest67750irq/123-lan10:10:133
5020991918,1cyclictest784-21snmpd08:48:440
5037991818,0cyclictest67750irq/123-lan12:35:163
5037991818,0cyclictest67750irq/123-lan10:58:193
5037991818,0cyclictest67750irq/123-lan10:45:173
5037991717,0cyclictest67750irq/123-lan12:32:083
5037991717,0cyclictest67750irq/123-lan11:55:163
5037991717,0cyclictest67750irq/123-lan11:25:533
5037991717,0cyclictest67750irq/123-lan11:10:043
5037991716,1cyclictest67750irq/123-lan10:50:153
5037991716,1cyclictest67750irq/123-lan10:05:143
5037991716,1cyclictest67750irq/123-lan09:45:113
5037991716,1cyclictest67750irq/123-lan07:30:063
5037991616,0cyclictest67750irq/123-lan10:42:193
5037991616,0cyclictest67750irq/123-lan09:50:153
5037991615,1cyclictest67750irq/123-lan11:00:203
5037991615,1cyclictest67750irq/123-lan09:40:143
5037991615,1cyclictest67750irq/123-lan07:45:113
5037991515,0cyclictest67750irq/123-lan11:07:213
5020991514,1cyclictest1437-21kworker/0:1+events10:25:350
5037991414,0cyclictest67750irq/123-lan07:28:193
5037991414,0cyclictest67750irq/123-lan07:10:113
5020991413,1cyclictest8574-21kworker/0:2+events11:22:490
5037991313,0cyclictest67750irq/123-lan07:35:183
5020991312,1cyclictest10956-21kworker/0:2+events09:32:010
5037991212,0cyclictest67750irq/123-lan07:50:173
5037991110,1cyclictest67750irq/123-lan07:15:153
5028991110,0cyclictest784-21snmpd08:02:551
502899109,0cyclictest784-21snmpd10:41:491
5028991010,0cyclictest784-21snmpd11:58:001
50339998,1cyclictest782-21lldpd11:10:502
50289999,0cyclictest784-21snmpd10:51:071
50289999,0cyclictest784-21snmpd10:46:521
50289999,0cyclictest784-21snmpd08:27:521
50289998,1cyclictest782-21lldpd09:06:111
50209998,1cyclictest782-21lldpd10:10:530
50209997,1cyclictest10956-21kworker/0:2+events09:13:130
50339988,0cyclictest784-21snmpd09:51:082
50339988,0cyclictest782-21lldpd09:31:192
50339988,0cyclictest782-21lldpd08:45:262
50339987,1cyclictest784-21snmpd11:06:372
50339987,1cyclictest526-21avahi-daemon10:23:272
50339986,2cyclictest784-21snmpd08:58:032
50339986,2cyclictest784-21snmpd08:41:022
50339985,3cyclictest784-21snmpd08:22:442
50289988,0cyclictest784-21snmpd12:15:001
50289988,0cyclictest784-21snmpd12:13:031
50289988,0cyclictest784-21snmpd11:45:181
50289988,0cyclictest784-21snmpd09:56:321
50289988,0cyclictest784-21snmpd09:46:501
50289988,0cyclictest784-21snmpd09:12:041
50289988,0cyclictest784-21snmpd08:22:081
50289988,0cyclictest784-21snmpd08:16:411
50289988,0cyclictest784-21snmpd08:08:371
50289988,0cyclictest784-21snmpd07:36:151
50289987,1cyclictest784-21snmpd10:23:061
50289987,1cyclictest782-21lldpd11:26:361
50289986,2cyclictest784-21snmpd11:14:051
50209988,0cyclictest784-21snmpd08:53:510
50209988,0cyclictest782-21lldpd12:20:330
50209988,0cyclictest782-21lldpd09:27:230
50209987,1cyclictest1437-21kworker/0:1+events10:31:090
50209986,2cyclictest784-21snmpd12:30:490
50209986,2cyclictest762-21ntpd08:26:080
50209986,2cyclictest762-21ntpd08:21:480
50209986,2cyclictest762-21ntpd07:31:320
50339977,0cyclictest784-21snmpd10:38:202
50339977,0cyclictest784-21snmpd10:11:422
50339977,0cyclictest784-21snmpd10:08:292
50339977,0cyclictest784-21snmpd08:00:432
50339977,0cyclictest784-21snmpd07:52:102
50339977,0cyclictest784-21snmpd07:46:432
50339977,0cyclictest784-21snmpd07:19:272
50339977,0cyclictest782-21lldpd12:16:052
50339977,0cyclictest782-21lldpd08:36:502
50339977,0cyclictest782-21lldpd08:11:222
50339976,1cyclictest784-21snmpd07:58:162
50339976,1cyclictest762-21ntpd10:19:512
50339976,1cyclictest526-21avahi-daemon12:38:222
50339976,1cyclictest526-21avahi-daemon11:40:262
50339975,2cyclictest784-21snmpd11:35:052
50339975,2cyclictest784-21snmpd11:00:342
50339975,2cyclictest784-21snmpd10:42:252
50339973,3cyclictest16702-21memory10:50:132
50289977,0cyclictest784-21snmpd12:08:031
50289977,0cyclictest784-21snmpd11:16:321
50289977,0cyclictest784-21snmpd09:24:191
50289977,0cyclictest784-21snmpd08:51:061
50289977,0cyclictest784-21snmpd08:13:251
50289977,0cyclictest782-21lldpd11:50:261
50289976,1cyclictest784-21snmpd09:53:081
50289976,1cyclictest784-21snmpd09:30:401
50289975,2cyclictest762-21ntpd09:04:371
50289973,3cyclictest9256-21ssh09:29:541
50209977,0cyclictest784-21snmpd07:19:170
50209976,1cyclictest8574-21kworker/0:2+events12:35:030
50209976,1cyclictest8574-21kworker/0:2+events12:25:130
50209976,1cyclictest8574-21kworker/0:2+events12:15:110
50209976,1cyclictest8574-21kworker/0:2+events12:10:020
50209976,1cyclictest8574-21kworker/0:2+events12:05:090
50209976,1cyclictest8574-21kworker/0:2+events11:25:250
50209976,1cyclictest526-21avahi-daemon08:15:030
50209976,1cyclictest1437-21kworker/0:1+events10:20:010
50209976,1cyclictest1437-21kworker/0:1+events10:05:010
50209976,1cyclictest14117-21kworker/0:1+events08:30:210
50209976,1cyclictest14117-21kworker/0:1+events08:10:150
50209976,1cyclictest14117-21kworker/0:1+events08:00:210
50209976,1cyclictest14117-21kworker/0:1+events07:55:390
50209976,1cyclictest14117-21kworker/0:1+events07:50:140
50209976,1cyclictest14117-21kworker/0:1+events07:48:410
50209976,1cyclictest14117-21kworker/0:1+events07:40:130
50209976,1cyclictest14117-21kworker/0:1+events07:37:590
50209976,1cyclictest14117-21kworker/0:1+events07:25:190
50209976,1cyclictest14117-21kworker/0:1+events07:20:130
50209976,1cyclictest14117-21kworker/0:1+events07:10:150
50209976,1cyclictest10956-21kworker/0:2+events09:35:030
50209976,1cyclictest10956-21kworker/0:2+events09:20:110
50209976,1cyclictest10956-21kworker/0:2+events09:15:270
50209976,1cyclictest10956-21kworker/0:2+events09:05:120
50339966,0cyclictest784-21snmpd09:15:222
50339966,0cyclictest784-21snmpd07:12:582
50339966,0cyclictest782-21lldpd09:10:492
50339966,0cyclictest782-21lldpd08:52:322
50339966,0cyclictest782-21lldpd08:08:292
50339965,1cyclictest14395-21fschecks_count09:35:132
50339964,2cyclictest9601-21cat12:30:132
50339964,2cyclictest784-21snmpd12:21:582
50339964,2cyclictest784-21snmpd09:26:222
50339964,2cyclictest547-21NetworkManager12:27:222
50339964,2cyclictest547-21NetworkManager11:58:542
50339963,3cyclictest547-21NetworkManager11:50:202
50339963,2cyclictest3976-21ssh11:47:062
50339963,2cyclictest27795-21ssh12:14:572
50339963,2cyclictest24721-21ssh09:45:402
50339963,2cyclictest2385-21ssh09:57:452
50339962,3cyclictest27610-21sed10:25:202
50339962,3cyclictest15463-21memory12:00:142
50289966,0cyclictest782-21lldpd10:34:321
50289966,0cyclictest782-21lldpd07:31:501
50289966,0cyclictest782-21lldpd07:25:351
50289966,0cyclictest526-21avahi-daemon08:56:551
50289965,1cyclictest762-21ntpd11:01:411
50289965,1cyclictest21022-21cat10:55:141
50289963,2cyclictest574-21rs:main1
50289961,1cyclictest191rcu_preempt12:22:111
50339955,0cyclictest784-21snmpd09:20:432
50339952,3cyclictest6622-21sshd08:29:532
50339952,3cyclictest19774-21cat12:05:132
50339952,2cyclictest6104-21ssh10:01:212
50339952,2cyclictest245-20systemd-journal09:05:372
50339952,2cyclictest13266-21ssh10:45:312
50289954,1cyclictest331ktimers/111:23:501
50289954,1cyclictest0-21swapper/111:05:111
50289953,2cyclictest784-21snmpd11:30:081
50289952,3cyclictest547-21NetworkManager10:35:111
50289952,2cyclictest574-21rs:main1
50289952,2cyclictest26022-21awk11:35:231
50289951,3cyclictest28454-21fw_packets09:15:121
50339941,2cyclictest562-21needreboot08:15:162
50339940,3cyclictest7637-21ntpq08:30:162
50339940,3cyclictest20569-21ssh10:55:112
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional