You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-28 - 20:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot6s.osadl.org (updated Tue Apr 28, 2026 12:43:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8343991919,0cyclictest65850irq/126-lan12:25:171
8343991918,1cyclictest65850irq/126-lan09:53:141
8343991918,1cyclictest65850irq/126-lan08:30:201
8350991818,0cyclictest743-21snmpd09:52:382
8343991817,1cyclictest65850irq/126-lan07:35:141
8350991717,0cyclictest743-21snmpd10:08:472
8343991717,0cyclictest65850irq/126-lan11:30:211
8343991717,0cyclictest65850irq/126-lan11:15:161
8343991717,0cyclictest65850irq/126-lan08:48:471
8343991717,0cyclictest65850irq/126-lan08:00:161
8343991716,1cyclictest65850irq/126-lan10:40:001
8343991716,1cyclictest65850irq/126-lan09:47:081
8343991716,1cyclictest65850irq/126-lan07:20:201
8343991715,1cyclictest743-21snmpd10:07:471
8350991616,0cyclictest743-21snmpd10:38:242
8350991616,0cyclictest743-21snmpd10:15:472
8350991616,0cyclictest743-21snmpd09:12:212
8350991616,0cyclictest743-21snmpd08:00:202
8350991615,0cyclictest743-21snmpd10:55:522
8343991616,0cyclictest743-21snmpd08:18:221
8343991616,0cyclictest65850irq/126-lan12:15:091
8343991616,0cyclictest65850irq/126-lan11:39:261
8343991616,0cyclictest65850irq/126-lan10:24:141
8343991616,0cyclictest65850irq/126-lan09:40:181
8343991616,0cyclictest65850irq/126-lan07:55:131
8343991615,1cyclictest65850irq/126-lan10:40:121
8343991615,1cyclictest65850irq/126-lan10:30:141
8343991615,1cyclictest65850irq/126-lan10:25:181
8343991615,1cyclictest65850irq/126-lan09:30:141
8343991615,1cyclictest65850irq/126-lan08:41:281
8343991615,1cyclictest65850irq/126-lan07:48:151
8343991615,1cyclictest65850irq/126-lan07:12:061
8350991515,0cyclictest743-21snmpd09:57:462
8350991515,0cyclictest743-21snmpd08:27:462
8350991515,0cyclictest743-21snmpd07:54:482
8343991515,0cyclictest743-21snmpd08:23:171
8343991515,0cyclictest743-21snmpd07:52:241
8343991515,0cyclictest65850irq/126-lan11:50:001
8343991515,0cyclictest65850irq/126-lan11:20:131
8343991515,0cyclictest65850irq/126-lan11:10:121
8343991515,0cyclictest65850irq/126-lan09:15:201
8343991515,0cyclictest65850irq/126-lan07:25:171
8343991514,1cyclictest65850irq/126-lan11:25:131
8343991514,1cyclictest65850irq/126-lan10:15:121
8343991514,1cyclictest65850irq/126-lan09:05:191
8343991514,1cyclictest65850irq/126-lan09:00:161
8350991414,0cyclictest743-21snmpd12:05:052
8350991414,0cyclictest743-21snmpd11:21:132
8350991414,0cyclictest743-21snmpd11:15:482
8350991414,0cyclictest743-21snmpd11:05:542
8350991414,0cyclictest743-21snmpd08:58:052
8350991414,0cyclictest743-21snmpd08:48:122
8350991414,0cyclictest743-21snmpd08:22:282
8350991414,0cyclictest743-21snmpd07:43:302
8350991414,0cyclictest29527-21cat09:20:152
8343991414,0cyclictest743-21snmpd12:02:151
8343991414,0cyclictest743-21snmpd07:34:371
8343991414,0cyclictest65850irq/126-lan12:23:461
8343991414,0cyclictest65850irq/126-lan11:55:171
8343991414,0cyclictest65850irq/126-lan11:00:151
8343991414,0cyclictest65850irq/126-lan09:23:201
8343991414,0cyclictest65850irq/126-lan07:40:121
8343991413,1cyclictest65850irq/126-lan10:00:141
8343991413,1cyclictest65850irq/126-lan08:25:131
8343991413,1cyclictest65850irq/126-lan08:05:121
8350991313,0cyclictest743-21snmpd11:40:292
8350991313,0cyclictest743-21snmpd11:36:492
8350991313,0cyclictest743-21snmpd10:49:482
8350991313,0cyclictest743-21snmpd08:06:192
8350991313,0cyclictest26237-21cat10:30:142
8343991313,0cyclictest7986-21cat11:05:141
8343991313,0cyclictest743-21snmpd10:59:491
8343991313,0cyclictest65850irq/126-lan12:35:121
8343991313,0cyclictest65850irq/126-lan12:30:161
8343991313,0cyclictest65850irq/126-lan12:05:181
8343991313,0cyclictest65850irq/126-lan11:45:181
8343991313,0cyclictest65850irq/126-lan10:50:201
8343991313,0cyclictest65850irq/126-lan10:15:001
8343991313,0cyclictest65850irq/126-lan08:35:211
8343991313,0cyclictest65850irq/126-lan08:13:551
8343991312,1cyclictest65850irq/126-lan07:15:471
8350991212,0cyclictest743-21snmpd11:11:222
8343991212,0cyclictest743-21snmpd12:10:501
8343991211,1cyclictest65850irq/126-lan10:45:131
8343991111,0cyclictest65850irq/126-lan09:35:191
8343991111,0cyclictest65850irq/126-lan09:25:111
8343991111,0cyclictest65850irq/126-lan08:50:161
8343991110,1cyclictest65850irq/126-lan09:10:161
8343991110,1cyclictest65850irq/126-lan08:58:101
835099109,1cyclictest15999-21gltestperf11:25:132
83559998,1cyclictest743-21snmpd12:27:493
83559998,1cyclictest743-21snmpd12:12:123
83559998,1cyclictest743-21snmpd09:45:253
83559998,1cyclictest743-21snmpd09:37:223
83559996,3cyclictest743-21snmpd09:32:543
83509999,0cyclictest743-21snmpd09:07:102
83439999,0cyclictest65850irq/126-lan09:55:121
83439998,1cyclictest65850irq/126-lan11:40:131
83389998,1cyclictest743-21snmpd09:48:160
83389998,1cyclictest743-21snmpd09:37:430
83389998,1cyclictest743-21snmpd07:20:330
83559988,0cyclictest743-21snmpd11:09:493
83559987,1cyclictest743-21snmpd11:39:463
83559987,1cyclictest743-21snmpd09:05:123
83559987,1cyclictest743-21snmpd08:41:443
83559987,1cyclictest743-21snmpd07:35:093
83559987,1cyclictest743-21snmpd07:20:453
83559987,1cyclictest743-21snmpd07:17:343
83559987,1cyclictest741-21lldpd10:14:563
83559987,0cyclictest191rcu_preempt11:29:013
83559986,2cyclictest743-21snmpd12:36:003
83559986,2cyclictest743-21snmpd09:58:073
83559986,2cyclictest31538-21grep08:05:133
83509988,0cyclictest743-21snmpd08:36:532
83509988,0cyclictest741-21lldpd11:57:042
83509988,0cyclictest741-21lldpd09:46:482
83509986,2cyclictest743-21snmpd08:52:002
83509986,2cyclictest743-21snmpd08:43:262
83509986,2cyclictest24195-21cat11:45:142
83509984,2cyclictest0-21swapper/211:30:172
83389988,0cyclictest743-21snmpd11:56:530
83389988,0cyclictest741-21lldpd12:22:250
83389988,0cyclictest741-21lldpd07:35:300
83389988,0cyclictest741-21lldpd07:19:220
83389987,1cyclictest743-21snmpd11:33:260
83389987,1cyclictest743-21snmpd10:10:500
83389987,1cyclictest743-21snmpd08:24:440
83389987,1cyclictest522-21avahi-daemon07:30:220
83389987,1cyclictest16723-21latency_hist08:50:000
83389986,2cyclictest743-21snmpd10:33:230
83389986,2cyclictest743-21snmpd09:20:310
83559977,0cyclictest741-21lldpd11:54:013
83559977,0cyclictest741-21lldpd10:55:463
83559977,0cyclictest741-21lldpd08:37:053
83559976,1cyclictest743-21snmpd11:01:573
83559976,1cyclictest743-21snmpd08:45:453
83559976,1cyclictest522-21avahi-daemon09:40:263
83559976,1cyclictest522-21avahi-daemon08:20:073
83559976,0cyclictest191rcu_preempt08:00:013
83559975,2cyclictest743-21snmpd09:23:193
83559975,2cyclictest743-21snmpd08:59:563
83559975,2cyclictest743-21snmpd08:50:203
83559975,0cyclictest191rcu_preempt10:51:253
83559973,2cyclictest52-21ksoftirqd/308:15:163
83559972,4cyclictest23218-21ls07:45:153
83559970,4cyclictest17454-21ld07:30:193
83509977,0cyclictest743-21snmpd12:12:152
83509977,0cyclictest743-21snmpd09:27:152
83509977,0cyclictest741-21lldpd07:30:292
83509977,0cyclictest741-21lldpd07:28:362
83509976,1cyclictest743-21snmpd08:12:012
83509976,1cyclictest741-21lldpd10:44:212
83509975,2cyclictest743-21snmpd12:19:332
83509975,2cyclictest743-21snmpd10:51:312
83509973,3cyclictest720-21apt-get09:30:132
83389977,0cyclictest743-21snmpd11:01:100
83389977,0cyclictest743-21snmpd09:57:170
83389977,0cyclictest743-21snmpd07:47:580
83389977,0cyclictest743-21snmpd07:25:450
83389977,0cyclictest741-21lldpd12:38:030
83389977,0cyclictest741-21lldpd12:32:570
83389977,0cyclictest741-21lldpd11:41:510
83389977,0cyclictest741-21lldpd11:38:190
83389977,0cyclictest506-21systemd-resolve12:08:270
83389976,1cyclictest743-21snmpd10:02:370
83389976,1cyclictest743-21snmpd08:25:370
83389976,1cyclictest741-21lldpd09:06:520
83389976,1cyclictest522-21avahi-daemon10:45:230
83389975,2cyclictest743-21snmpd11:27:350
83389975,2cyclictest743-21snmpd08:12:460
83389975,2cyclictest27489-21cat09:15:140
83559966,0cyclictest743-21snmpd07:10:173
83559966,0cyclictest741-21lldpd09:53:473
83559965,1cyclictest743-21snmpd12:22:453
83559965,1cyclictest743-21snmpd09:01:033
83559965,1cyclictest522-21avahi-daemon10:09:543
83559965,1cyclictest511ktimers/311:15:173
83559965,0cyclictest191rcu_preempt11:59:273
83559965,0cyclictest191rcu_preempt11:45:203
83559965,0cyclictest191rcu_preempt10:35:093
83559965,0cyclictest191rcu_preempt10:22:233
83559965,0cyclictest191rcu_preempt09:15:133
83559964,2cyclictest8334-21cyclictest07:50:183
83559964,2cyclictest743-21snmpd07:58:163
83559964,0cyclictest191rcu_preempt10:44:553
83559963,2cyclictest14874-21gpgv10:05:003
83559963,1cyclictest52-21ksoftirqd/312:15:013
83559963,1cyclictest191rcu_preempt10:15:153
83559962,4cyclictest557-21NetworkManager07:28:133
83559961,2cyclictest52-21ksoftirqd/312:00:223
83509966,0cyclictest743-21snmpd11:04:002
83509966,0cyclictest506-21systemd-resolve09:15:202
83509964,2cyclictest743-21snmpd09:36:582
83509962,3cyclictest9212-21fw_packets08:30:132
83509962,3cyclictest18024-21fw_forwarded_lo10:10:132
83389966,0cyclictest743-21snmpd10:42:330
83389966,0cyclictest743-21snmpd07:56:360
83389966,0cyclictest741-21lldpd11:22:490
83389966,0cyclictest741-21lldpd08:05:110
83389966,0cyclictest741-21lldpd07:53:220
83389966,0cyclictest522-21avahi-daemon10:57:330
83389965,1cyclictest7737-21fschecks_count11:05:130
83389965,1cyclictest743-21snmpd09:10:450
83389965,1cyclictest743-21snmpd08:38:000
83389965,1cyclictest741-21lldpd12:01:240
83389965,1cyclictest741-21lldpd09:40:360
83389965,1cyclictest741-21lldpd08:00:000
83389965,1cyclictest3043-21fschecks_count08:15:120
83389965,1cyclictest21324-21gltestperf09:00:130
83389964,2cyclictest743-21snmpd11:49:260
83389964,2cyclictest743-21snmpd10:20:320
83389964,2cyclictest743-21snmpd10:17:380
83389964,2cyclictest743-21snmpd08:42:020
83389964,2cyclictest743-21snmpd08:30:190
83389964,2cyclictest743-21snmpd07:11:470
83389963,3cyclictest4910-21sensors_temp12:15:170
83389963,2cyclictest244-20systemd-journal08:50:170
83389962,3cyclictest16368-21wc10:05:210
83559955,0cyclictest9657-21ntpq08:30:163
83559955,0cyclictest511ktimers/311:20:173
83559955,0cyclictest0-21swapper/312:30:323
83559954,1cyclictest23868-21cpuspeed_turbos10:25:113
83559954,0cyclictest191rcu_preempt11:10:173
83559954,0cyclictest191rcu_preempt09:27:153
83559954,0cyclictest191rcu_preempt08:10:163
83559952,1cyclictest191rcu_preempt12:05:163
83559952,1cyclictest191rcu_preempt11:30:123
83559952,1cyclictest191rcu_preempt10:49:313
83559951,0cyclictest191rcu_preempt07:40:193
83559950,3cyclictest52-21ksoftirqd/308:25:113
83559950,3cyclictest26568-21ntpq10:30:163
83559950,3cyclictest25434-21hddtemp_smartct09:10:133
83559950,3cyclictest22383-21needreboot11:40:163
83509955,0cyclictest741-21lldpd12:38:532
83509955,0cyclictest741-21lldpd12:26:582
83509955,0cyclictest741-21lldpd07:55:442
83509955,0cyclictest522-21avahi-daemon07:18:312
83509954,1cyclictest743-21snmpd10:25:122
83509954,1cyclictest411rcuc/212:30:172
83509953,2cyclictest743-21snmpd12:00:392
83509953,2cyclictest743-21snmpd07:13:112
83509952,3cyclictest22924-21grep07:45:132
83509952,2cyclictest26873-21wc11:50:192
83509951,3cyclictest5081-21fw_packets09:40:142
83509951,3cyclictest20104-21seq07:36:512
83509951,1cyclictest191rcu_preempt10:00:172
83509950,3cyclictest7732-21cat12:25:002
83509950,2cyclictest3706-21ntpq08:15:172
83389955,0cyclictest741-21lldpd11:12:340
83389955,0cyclictest741-21lldpd10:36:340
83389954,1cyclictest743-21snmpd10:54:210
83389954,1cyclictest522-21avahi-daemon12:10:270
83389954,1cyclictest0-21swapper/009:50:150
83389953,2cyclictest743-21snmpd08:55:020
83389952,3cyclictest1448-21ntpq09:30:170
83389951,4cyclictest557-21NetworkManager12:25:290
83389951,3cyclictest31719-21sed09:25:150
83389951,3cyclictest21655-21ps07:40:170
83389951,2cyclictest13508-21cat11:20:010
83509942,2cyclictest717-21ntpd09:00:072
83509941,2cyclictest12640-21awk07:20:122
83509940,3cyclictest22609-21ntp_states10:20:162
83389941,2cyclictest25937-21fschecks_count11:50:110
83389940,3cyclictest23962-21diskstats10:25:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional