You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-11 - 00:06

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Wed Jun 10, 2026 12:43:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28957993837,1cyclictest11515-21fwupd09:00:341
28970991918,1cyclictest65850irq/126-lan11:20:003
28970991818,0cyclictest65850irq/126-lan11:45:193
28957991818,0cyclictest65850irq/126-lan11:04:501
28957991818,0cyclictest65850irq/126-lan07:50:531
28957991818,0cyclictest65850irq/126-lan07:25:191
28957991817,1cyclictest65850irq/126-lan09:05:151
28970991717,0cyclictest65850irq/126-lan11:23:453
28970991716,1cyclictest65850irq/126-lan12:25:183
28957991717,0cyclictest65850irq/126-lan10:20:101
28957991717,0cyclictest65850irq/126-lan10:14:391
28957991717,0cyclictest65850irq/126-lan09:57:341
28957991717,0cyclictest65850irq/126-lan08:35:191
28957991717,0cyclictest65850irq/126-lan08:30:341
28957991717,0cyclictest65850irq/126-lan07:45:131
28957991716,1cyclictest65850irq/126-lan09:40:001
28970991616,0cyclictest65850irq/126-lan11:52:333
28970991615,1cyclictest65850irq/126-lan11:55:133
28970991615,1cyclictest65850irq/126-lan11:30:203
28957991616,0cyclictest65850irq/126-lan10:31:161
28957991616,0cyclictest65850irq/126-lan09:36:561
28957991616,0cyclictest65850irq/126-lan08:45:331
28957991616,0cyclictest65850irq/126-lan08:25:311
28957991616,0cyclictest65850irq/126-lan08:15:011
28957991616,0cyclictest65850irq/126-lan08:05:161
28957991616,0cyclictest65850irq/126-lan08:00:111
28957991616,0cyclictest65850irq/126-lan07:43:281
28957991616,0cyclictest65850irq/126-lan07:35:121
28957991616,0cyclictest65850irq/126-lan07:15:111
28970991515,0cyclictest65850irq/126-lan12:36:523
28970991514,1cyclictest65850irq/126-lan12:05:173
28957991515,0cyclictest65850irq/126-lan11:05:131
28957991515,0cyclictest65850irq/126-lan10:55:111
28957991515,0cyclictest65850irq/126-lan10:05:181
28957991515,0cyclictest65850irq/126-lan09:20:201
28957991515,0cyclictest65850irq/126-lan08:55:361
28957991515,0cyclictest65850irq/126-lan08:10:131
28957991514,1cyclictest65850irq/126-lan07:20:171
28970991414,0cyclictest65850irq/126-lan11:09:163
28970991413,1cyclictest65850irq/126-lan12:20:133
28970991413,1cyclictest65850irq/126-lan12:10:113
28970991413,1cyclictest65850irq/126-lan11:40:133
28970991413,1cyclictest65850irq/126-lan11:29:353
28970991413,1cyclictest65850irq/126-lan11:10:163
28957991414,0cyclictest65850irq/126-lan10:36:081
28957991414,0cyclictest65850irq/126-lan10:15:151
28957991414,0cyclictest65850irq/126-lan09:10:161
28957991414,0cyclictest65850irq/126-lan07:55:111
28957991313,0cyclictest65850irq/126-lan10:45:221
28957991313,0cyclictest65850irq/126-lan09:25:101
28957991313,0cyclictest65850irq/126-lan09:15:111
28957991313,0cyclictest65850irq/126-lan08:20:071
28957991313,0cyclictest65850irq/126-lan07:10:121
28970991212,0cyclictest65850irq/126-lan12:03:353
28970991211,1cyclictest65850irq/126-lan12:30:163
28970991211,1cyclictest65850irq/126-lan12:15:113
28970991211,1cyclictest65850irq/126-lan11:35:173
28957991212,0cyclictest65850irq/126-lan10:40:211
28957991212,0cyclictest65850irq/126-lan10:03:341
28957991212,0cyclictest65850irq/126-lan09:50:141
28957991111,0cyclictest65850irq/126-lan09:30:101
28957991110,1cyclictest65850irq/126-lan08:50:101
28957991010,0cyclictest65850irq/126-lan09:45:121
289579999,0cyclictest65850irq/126-lan10:29:591
289529998,1cyclictest743-21snmpd10:49:330
289529998,1cyclictest743-21snmpd07:27:190
289709988,0cyclictest743-21snmpd10:40:463
289709988,0cyclictest743-21snmpd09:42:373
289709988,0cyclictest743-21snmpd08:10:423
289709988,0cyclictest743-21snmpd07:37:383
289709988,0cyclictest741-21lldpd10:04:383
289709988,0cyclictest741-21lldpd09:23:273
289709988,0cyclictest741-21lldpd07:45:543
289709987,1cyclictest743-21snmpd10:29:523
289709987,1cyclictest743-21snmpd07:31:243
289709987,1cyclictest743-21snmpd07:26:103
289709987,1cyclictest741-21lldpd10:45:553
289709986,2cyclictest743-21snmpd09:11:303
289709986,2cyclictest743-21snmpd08:53:513
289709986,2cyclictest743-21snmpd08:18:483
289709986,2cyclictest743-21snmpd07:52:563
289659988,0cyclictest741-21lldpd10:36:132
289659987,1cyclictest743-21snmpd12:25:302
289659987,1cyclictest743-21snmpd08:07:422
289659986,2cyclictest743-21snmpd09:53:342
289659986,2cyclictest743-21snmpd09:25:572
289579988,0cyclictest743-21snmpd12:13:031
289579986,1cyclictest14874-21kworker/1:1+events08:41:321
289529988,0cyclictest743-21snmpd11:22:190
289529988,0cyclictest741-21lldpd09:31:120
289529987,1cyclictest743-21snmpd10:35:570
289529987,1cyclictest743-21snmpd10:29:150
289529987,1cyclictest743-21snmpd10:04:470
289529987,1cyclictest743-21snmpd07:55:200
289529987,1cyclictest741-21lldpd10:11:590
289529986,2cyclictest743-21snmpd11:59:540
289529986,2cyclictest743-21snmpd11:36:200
289529986,2cyclictest743-21snmpd10:42:090
289529986,2cyclictest743-21snmpd07:34:500
289529986,2cyclictest717-21ntpd11:15:210
289529986,2cyclictest717-21ntpd11:10:180
289529986,2cyclictest717-21ntpd09:15:200
289529986,2cyclictest717-21ntpd08:30:180
289529986,2cyclictest717-21ntpd07:50:220
289529986,2cyclictest717-21ntpd07:35:130
289709977,0cyclictest743-21snmpd10:15:113
289709977,0cyclictest743-21snmpd08:23:013
289709977,0cyclictest743-21snmpd08:06:153
289709977,0cyclictest743-21snmpd07:23:043
289709977,0cyclictest741-21lldpd10:38:173
289709976,1cyclictest743-21snmpd08:30:043
289709976,1cyclictest522-21avahi-daemon11:02:123
289709975,2cyclictest743-21snmpd10:21:293
289709975,2cyclictest743-21snmpd10:13:143
289709975,2cyclictest743-21snmpd09:17:483
289709975,2cyclictest743-21snmpd09:06:403
289709975,2cyclictest743-21snmpd09:02:393
289709975,2cyclictest743-21snmpd08:26:013
289709975,2cyclictest743-21snmpd07:56:363
289709974,3cyclictest743-21snmpd07:11:523
289659977,0cyclictest743-21snmpd11:42:442
289659977,0cyclictest743-21snmpd09:47:552
289659977,0cyclictest741-21lldpd12:38:152
289659977,0cyclictest741-21lldpd12:22:302
289659977,0cyclictest741-21lldpd10:11:132
289659977,0cyclictest741-21lldpd10:07:142
289659977,0cyclictest741-21lldpd08:44:432
289659977,0cyclictest741-21lldpd07:43:242
289659977,0cyclictest741-21lldpd07:27:402
289659976,1cyclictest743-21snmpd09:21:552
289659976,1cyclictest573-21in:imuxsock07:46:452
289659976,1cyclictest522-21avahi-daemon07:12:272
289659976,1cyclictest506-21systemd-resolve08:15:002
289659975,2cyclictest743-21snmpd11:25:532
289659975,2cyclictest743-21snmpd09:01:032
289659974,2cyclictest3652-21ntp_states11:20:162
289579977,0cyclictest65850irq/126-lan10:50:161
289579977,0cyclictest65850irq/126-lan07:30:171
289579976,1cyclictest14874-21kworker/1:1+events12:35:241
289579976,1cyclictest14874-21kworker/1:1+events12:30:111
289579976,1cyclictest14874-21kworker/1:1+events12:26:281
289579976,1cyclictest14874-21kworker/1:1+events12:20:361
289579976,1cyclictest14874-21kworker/1:1+events12:15:031
289579976,1cyclictest14874-21kworker/1:1+events12:05:101
289579976,1cyclictest14874-21kworker/1:1+events12:00:431
289579976,1cyclictest14874-21kworker/1:1+events11:55:101
289579976,1cyclictest14874-21kworker/1:1+events11:50:081
289579976,1cyclictest14874-21kworker/1:1+events11:45:591
289579976,1cyclictest14874-21kworker/1:1+events11:40:021
289579976,1cyclictest14874-21kworker/1:1+events11:35:181
289579976,1cyclictest14874-21kworker/1:1+events11:30:091
289579976,1cyclictest14874-21kworker/1:1+events11:25:041
289579976,1cyclictest14874-21kworker/1:1+events11:20:241
289579976,1cyclictest14874-21kworker/1:1+events11:16:191
289579976,1cyclictest14874-21kworker/1:1+events11:10:041
289529977,0cyclictest743-21snmpd09:42:230
289529977,0cyclictest741-21lldpd08:06:520
289529977,0cyclictest741-21lldpd08:01:270
289529976,1cyclictest743-21snmpd08:55:560
289529976,1cyclictest717-21ntpd12:05:160
289529975,2cyclictest743-21snmpd10:57:040
289529975,2cyclictest743-21snmpd09:35:400
289529975,2cyclictest743-21snmpd09:26:520
289529975,2cyclictest743-21snmpd09:13:390
289529975,2cyclictest743-21snmpd07:42:140
289529975,2cyclictest717-21ntpd09:55:020
289529975,2cyclictest717-21ntpd09:50:190
289529975,2cyclictest717-21ntpd08:35:240
289529973,3cyclictest24641-21ntpq08:15:170
289709966,0cyclictest741-21lldpd07:17:183
289709966,0cyclictest522-21avahi-daemon09:26:293
289709965,1cyclictest8159-21cpuspeed_turbos08:55:113
289709965,1cyclictest743-21snmpd09:55:593
289709964,2cyclictest743-21snmpd10:30:543
289709964,2cyclictest743-21snmpd10:07:353
289709963,3cyclictest24549-21fw_conntrack09:35:123
289709962,3cyclictest244-20systemd-journal08:47:163
289659966,0cyclictest743-21snmpd09:37:462
289659966,0cyclictest741-21lldpd12:03:012
289659966,0cyclictest741-21lldpd11:49:312
289659966,0cyclictest522-21avahi-daemon12:15:462
289659966,0cyclictest522-21avahi-daemon11:15:002
289659966,0cyclictest522-21avahi-daemon10:43:532
289659965,1cyclictest743-21snmpd11:30:302
289659965,1cyclictest743-21snmpd08:45:322
289659965,1cyclictest741-21lldpd11:07:352
289659965,1cyclictest5104-21fschecks_time07:30:122
289659965,1cyclictest28377-21cat08:25:132
289659965,1cyclictest26604-21grep08:20:162
289659963,3cyclictest10820-21ntpq10:20:152
289529966,0cyclictest743-21snmpd10:33:540
289529966,0cyclictest743-21snmpd07:45:110
289529965,1cyclictest743-21snmpd12:15:160
289529965,1cyclictest743-21snmpd12:10:060
289529965,1cyclictest717-21ntpd07:10:210
289529964,2cyclictest19414-21cat12:00:140
289529963,3cyclictest743-21snmpd08:40:080
289529962,4cyclictest557-21NetworkManager11:29:570
289529962,4cyclictest557-21NetworkManager09:20:550
289529962,3cyclictest743-21snmpd09:02:450
289529962,3cyclictest244-20systemd-journal08:10:240
289709955,0cyclictest741-21lldpd09:45:083
289709954,1cyclictest30298-21/usr/sbin/munin09:50:183
289709952,2cyclictest26088-21sed10:55:203
289659955,0cyclictest741-21lldpd12:05:562
289659955,0cyclictest741-21lldpd11:39:362
289659955,0cyclictest741-21lldpd09:56:042
289659955,0cyclictest741-21lldpd07:22:302
289659955,0cyclictest522-21avahi-daemon08:36:392
289659954,1cyclictest743-21snmpd09:41:162
289659954,1cyclictest743-21snmpd07:35:232
289659953,2cyclictest743-21snmpd10:29:462
289659953,2cyclictest557-21NetworkManager07:15:122
289659952,3cyclictest557-21NetworkManager09:34:052
289659952,3cyclictest20840-21perl10:45:132
289659952,3cyclictest16494-21cut07:55:142
289659952,2cyclictest31928-21ntpq11:10:162
289659952,2cyclictest27814-21ld11:00:162
289659952,2cyclictest244-20systemd-journal10:19:082
289659952,2cyclictest2325-21sed10:00:132
289659951,3cyclictest9086-21find08:55:172
289659951,3cyclictest23719-21ld10:50:152
289659951,3cyclictest18051-21cut08:00:122
289659951,3cyclictest16925-21gcc09:15:152
289529953,2cyclictest743-21snmpd10:09:590
289529953,2cyclictest717-21ntpd08:25:080
289529953,2cyclictest717-21ntpd07:15:530
289529953,2cyclictest29206-21cut11:05:110
289529952,3cyclictest743-21snmpd12:27:120
289529952,3cyclictest557-21NetworkManager11:31:580
289529952,3cyclictest557-21NetworkManager10:18:340
289529952,2cyclictest28730-21sshd11:04:160
289529952,2cyclictest28005-21cut12:20:180
289529952,2cyclictest244-20systemd-journal09:46:350
289529952,2cyclictest11460-21wc11:40:160
289529951,3cyclictest32730-21sed12:30:210
289529950,4cyclictest1554-21ntpq07:20:160
289709943,1cyclictest0-21swapper/307:40:123
289709942,2cyclictest1905-21grep08:40:123
289709941,2cyclictest23214-21expr10:50:123
289709941,2cyclictest23022-21ld09:30:153
289709941,2cyclictest18037-21forks08:00:123
289709940,3cyclictest376-21ntp_states08:35:203
289659943,1cyclictest421ktimers/208:30:142
289659943,1cyclictest14164-21cpuspeed_turbos10:30:112
289659942,2cyclictest743-21snmpd10:55:442
289659942,2cyclictest6125-21cpuspeed_turbos08:50:112
289659941,3cyclictest557-21NetworkManager12:30:062
289659941,3cyclictest13577-21awk07:50:002
289659941,2cyclictest24464-21seq12:11:412
289659941,2cyclictest244-20systemd-journal08:12:162
289659941,2cyclictest14921-21apt-get11:50:112
289659940,4cyclictest17662-21ntpq11:55:172
289659940,4cyclictest12922-21ntpq09:05:162
289659940,3cyclictest14334-21diskstats09:10:112
289529944,0cyclictest741-21lldpd09:05:050
289529942,2cyclictest743-21snmpd11:55:000
289529942,2cyclictest4154-21sed08:45:140
289529942,2cyclictest1274-21expr12:35:130
289529941,2cyclictest10378-21expr10:20:120
289529940,4cyclictest23770-21ntpq10:50:150
289529940,3cyclictest6022-21cp08:50:000
289529940,3cyclictest26227-21perl08:20:130
289529940,3cyclictest13233-21grep11:45:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional