You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-17 - 21:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot6s.osadl.org (updated Wed Jun 17, 2026 12:43:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
23135992726,1cyclictest12180-21fwupd12:00:021
23148991919,0cyclictest65850irq/126-lan12:32:003
23148991918,1cyclictest65850irq/126-lan08:55:173
23148991818,0cyclictest65850irq/126-lan10:15:133
23148991817,1cyclictest65850irq/126-lan12:25:143
23148991817,1cyclictest65850irq/126-lan11:50:193
23148991817,1cyclictest65850irq/126-lan10:30:173
23148991817,1cyclictest65850irq/126-lan09:04:043
23148991817,1cyclictest65850irq/126-lan08:40:123
23148991817,1cyclictest65850irq/126-lan07:50:163
23148991717,0cyclictest65850irq/126-lan11:20:193
23148991717,0cyclictest65850irq/126-lan09:35:223
23148991716,1cyclictest65850irq/126-lan08:30:123
23148991716,1cyclictest65850irq/126-lan08:15:173
23143991717,0cyclictest743-21snmpd12:35:342
23143991717,0cyclictest743-21snmpd12:28:042
23143991717,0cyclictest743-21snmpd12:08:392
23143991717,0cyclictest743-21snmpd10:22:252
23143991717,0cyclictest743-21snmpd10:16:242
23143991717,0cyclictest743-21snmpd09:15:132
23143991717,0cyclictest743-21snmpd08:17:352
23143991717,0cyclictest743-21snmpd07:47:402
23143991717,0cyclictest26553-21cat09:55:122
23148991616,0cyclictest65850irq/126-lan11:35:233
23148991616,0cyclictest65850irq/126-lan11:30:203
23148991616,0cyclictest65850irq/126-lan10:55:123
23148991616,0cyclictest65850irq/126-lan10:03:073
23148991616,0cyclictest65850irq/126-lan09:45:143
23148991616,0cyclictest65850irq/126-lan08:35:163
23148991616,0cyclictest65850irq/126-lan08:10:173
23148991616,0cyclictest65850irq/126-lan07:45:143
23148991615,1cyclictest65850irq/126-lan12:00:003
23148991615,1cyclictest65850irq/126-lan11:19:003
23148991615,1cyclictest65850irq/126-lan11:00:183
23148991615,1cyclictest65850irq/126-lan10:50:173
23143991616,0cyclictest743-21snmpd12:32:382
23143991616,0cyclictest743-21snmpd12:17:282
23148991515,0cyclictest65850irq/126-lan12:20:203
23148991515,0cyclictest65850irq/126-lan09:33:573
23148991515,0cyclictest65850irq/126-lan09:05:113
23148991515,0cyclictest65850irq/126-lan07:25:153
23148991515,0cyclictest65850irq/126-lan07:15:163
23148991514,1cyclictest65850irq/126-lan11:25:203
23148991514,1cyclictest65850irq/126-lan10:45:133
23148991514,1cyclictest65850irq/126-lan10:20:183
23148991514,1cyclictest65850irq/126-lan09:50:163
23148991514,1cyclictest65850irq/126-lan09:25:003
23130991515,0cyclictest743-21snmpd11:18:170
23148991414,0cyclictest65850irq/126-lan12:10:183
23148991414,0cyclictest65850irq/126-lan11:05:123
23148991414,0cyclictest65850irq/126-lan10:40:113
23148991414,0cyclictest65850irq/126-lan09:20:143
23148991414,0cyclictest65850irq/126-lan09:15:123
23148991414,0cyclictest65850irq/126-lan07:20:203
23148991413,1cyclictest65850irq/126-lan10:05:183
23148991413,1cyclictest65850irq/126-lan07:55:123
23148991413,1cyclictest65850irq/126-lan07:40:203
23148991413,1cyclictest65850irq/126-lan07:35:193
23130991414,0cyclictest743-21snmpd11:09:200
23130991414,0cyclictest743-21snmpd08:52:580
23148991313,0cyclictest65850irq/126-lan12:08:583
23148991313,0cyclictest65850irq/126-lan09:10:163
23148991313,0cyclictest65850irq/126-lan08:25:143
23148991312,1cyclictest65850irq/126-lan12:00:013
23148991312,1cyclictest65850irq/126-lan11:45:203
23148991312,1cyclictest65850irq/126-lan11:40:213
23148991312,1cyclictest65850irq/126-lan10:35:213
23148991312,1cyclictest65850irq/126-lan10:25:123
23148991312,1cyclictest65850irq/126-lan07:10:253
23143991313,0cyclictest743-21snmpd07:14:062
23130991313,0cyclictest743-21snmpd11:11:000
23130991313,0cyclictest743-21snmpd07:19:190
23148991212,0cyclictest65850irq/126-lan12:35:133
23148991212,0cyclictest65850irq/126-lan09:55:143
23148991211,1cyclictest65850irq/126-lan10:10:123
23148991211,1cyclictest65850irq/126-lan09:40:093
23148991211,1cyclictest65850irq/126-lan08:45:203
23148991211,1cyclictest65850irq/126-lan07:35:003
23143991212,0cyclictest8589-21cat11:50:132
23143991212,0cyclictest743-21snmpd09:20:432
23148991111,0cyclictest65850irq/126-lan11:10:163
23148991110,1cyclictest65850irq/126-lan08:00:163
23130991111,0cyclictest743-21snmpd11:51:210
23130991111,0cyclictest743-21snmpd10:37:370
23130991111,0cyclictest743-21snmpd09:33:020
23130991111,0cyclictest743-21snmpd09:07:460
23130991111,0cyclictest743-21snmpd08:05:050
23130991111,0cyclictest743-21snmpd07:55:110
23130991111,0cyclictest743-21snmpd07:32:290
23130991010,0cyclictest743-21snmpd12:32:200
23130991010,0cyclictest743-21snmpd12:00:580
23130991010,0cyclictest743-21snmpd11:44:150
23130991010,0cyclictest743-21snmpd11:26:180
23130991010,0cyclictest743-21snmpd10:58:530
23130991010,0cyclictest743-21snmpd10:43:350
23130991010,0cyclictest743-21snmpd10:13:330
23130991010,0cyclictest743-21snmpd10:08:390
23130991010,0cyclictest743-21snmpd09:56:170
23130991010,0cyclictest743-21snmpd09:24:300
23130991010,0cyclictest743-21snmpd07:54:320
23130991010,0cyclictest4690-21cat10:20:130
231489998,1cyclictest743-21snmpd08:24:093
231359998,1cyclictest743-21snmpd10:53:371
231309999,0cyclictest743-21snmpd12:21:130
231309999,0cyclictest743-21snmpd12:11:240
231309999,0cyclictest743-21snmpd12:06:570
231309999,0cyclictest743-21snmpd10:48:520
231309999,0cyclictest743-21snmpd10:30:010
231309999,0cyclictest743-21snmpd09:47:260
231309999,0cyclictest743-21snmpd09:10:490
231309999,0cyclictest743-21snmpd08:23:420
231309999,0cyclictest743-21snmpd07:28:580
231309999,0cyclictest2538-21cat11:35:140
231309998,1cyclictest743-21snmpd10:01:090
231489988,0cyclictest65850irq/126-lan08:05:163
231439988,0cyclictest743-21snmpd07:29:222
231439988,0cyclictest741-21lldpd11:45:592
231439988,0cyclictest741-21lldpd10:58:482
231439988,0cyclictest741-21lldpd08:49:022
231439987,1cyclictest741-21lldpd10:00:342
231439986,2cyclictest743-21snmpd11:03:562
231439986,2cyclictest743-21snmpd10:33:342
231439986,2cyclictest743-21snmpd09:52:272
231359988,0cyclictest743-21snmpd10:25:091
231359988,0cyclictest743-21snmpd10:15:061
231359988,0cyclictest743-21snmpd08:42:211
231359988,0cyclictest743-21snmpd07:20:071
231359988,0cyclictest741-21lldpd11:17:311
231359988,0cyclictest741-21lldpd09:47:141
231359987,1cyclictest743-21snmpd10:32:311
231359987,1cyclictest743-21snmpd08:52:341
231359986,2cyclictest743-21snmpd12:26:311
231359986,2cyclictest743-21snmpd11:40:521
231309988,0cyclictest743-21snmpd11:23:110
231309988,0cyclictest743-21snmpd10:26:310
231309988,0cyclictest743-21snmpd10:17:270
231309988,0cyclictest743-21snmpd08:55:070
231309988,0cyclictest741-21lldpd09:44:480
231309988,0cyclictest741-21lldpd08:30:130
231309987,1cyclictest522-21avahi-daemon08:35:200
231309987,1cyclictest506-21systemd-resolve07:11:050
231309986,2cyclictest743-21snmpd09:27:350
231489977,0cyclictest743-21snmpd12:15:463
231489977,0cyclictest65850irq/126-lan08:50:113
231439977,0cyclictest743-21snmpd09:43:502
231439977,0cyclictest743-21snmpd07:42:492
231439977,0cyclictest522-21avahi-daemon08:14:062
231439976,1cyclictest743-21snmpd10:37:402
231439976,1cyclictest743-21snmpd10:06:462
231439976,1cyclictest743-21snmpd08:41:182
231439976,1cyclictest741-21lldpd07:34:122
231439975,2cyclictest743-21snmpd11:55:282
231439975,2cyclictest743-21snmpd10:47:312
231439975,2cyclictest743-21snmpd09:11:522
231439975,2cyclictest743-21snmpd09:07:072
231439975,2cyclictest743-21snmpd08:54:492
231439975,1cyclictest191rcu_preempt10:50:112
231359977,0cyclictest7601-21cron09:10:001
231359977,0cyclictest743-21snmpd11:52:361
231359977,0cyclictest741-21lldpd11:23:011
231359977,0cyclictest741-21lldpd11:14:101
231359977,0cyclictest741-21lldpd10:20:321
231359977,0cyclictest741-21lldpd09:29:241
231359977,0cyclictest741-21lldpd08:56:371
231359977,0cyclictest522-21avahi-daemon07:16:091
231359976,1cyclictest743-21snmpd11:25:181
231359976,1cyclictest743-21snmpd09:37:301
231359976,1cyclictest743-21snmpd07:58:561
231359976,1cyclictest741-21lldpd11:09:091
231359976,1cyclictest23403-21cpuspeed_turbos07:10:121
231359975,2cyclictest743-21snmpd10:55:531
231359975,2cyclictest743-21snmpd09:32:201
231359975,2cyclictest743-21snmpd08:48:211
231359975,2cyclictest743-21snmpd08:05:201
231359975,2cyclictest743-21snmpd07:41:581
231359975,2cyclictest449-21cat11:30:131
231359973,3cyclictest20295-21apt12:20:111
231359972,5cyclictest557-21NetworkManager09:56:071
231309977,0cyclictest741-21lldpd08:28:450
231309976,1cyclictest1098-21cpuspeed_turbos07:35:130
231309975,2cyclictest743-21snmpd11:59:390
231309975,2cyclictest4278-21cat09:00:150
231439966,0cyclictest743-21snmpd12:10:102
231439966,0cyclictest743-21snmpd11:13:272
231439966,0cyclictest741-21lldpd12:03:142
231439966,0cyclictest741-21lldpd08:32:342
231439966,0cyclictest522-21avahi-daemon12:24:392
231439965,1cyclictest743-21snmpd09:25:262
231439965,1cyclictest522-21avahi-daemon09:48:172
231439964,2cyclictest743-21snmpd11:30:112
231439964,2cyclictest743-21snmpd09:38:352
231439963,3cyclictest16183-21df_inode09:30:142
231439963,2cyclictest19775-21tr08:20:122
231439962,3cyclictest1186-21df_inode07:35:132
231359966,0cyclictest743-21snmpd11:35:241
231359966,0cyclictest743-21snmpd10:07:521
231359966,0cyclictest741-21lldpd08:12:131
231359966,0cyclictest741-21lldpd07:34:081
231359966,0cyclictest522-21avahi-daemon08:17:431
231359965,1cyclictest522-21avahi-daemon09:15:161
231359965,1cyclictest506-21systemd-resolve11:58:291
231359965,1cyclictest32136-21/usr/sbin/munin10:10:161
231359965,1cyclictest12267-21gltestperf09:20:131
231359964,2cyclictest743-21snmpd12:05:301
231359964,2cyclictest743-21snmpd10:00:091
231359962,3cyclictest20527-21ntp_states08:20:181
231309966,0cyclictest743-21snmpd07:23:400
231309966,0cyclictest741-21lldpd10:50:430
231309966,0cyclictest741-21lldpd09:50:400
231309966,0cyclictest741-21lldpd08:17:210
231309965,1cyclictest22963-21fschecks_time12:25:110
231309963,2cyclictest27535-21sshd12:35:160
231439955,0cyclictest741-21lldpd11:36:512
231439954,1cyclictest743-21snmpd10:25:392
231439954,1cyclictest743-21snmpd08:57:372
231439953,2cyclictest717-21ntpd11:20:262
231439952,3cyclictest717-21ntpd10:40:092
231439952,3cyclictest26432-21fw_conntrack08:35:122
231439952,2cyclictest32433-21grep10:10:112
231439952,2cyclictest23025-21sed08:25:222
231439952,2cyclictest14466-21ld08:05:182
231439951,4cyclictest557-21NetworkManager08:01:092
231439951,3cyclictest30894-21if_err_lan11:25:132
231359955,0cyclictest743-21snmpd07:52:141
231359954,1cyclictest743-21snmpd08:32:451
231359954,1cyclictest741-21lldpd11:01:411
231359954,1cyclictest331ktimers/109:00:121
231359953,2cyclictest743-21snmpd10:36:101
231359953,2cyclictest743-21snmpd09:10:131
231359953,2cyclictest743-21snmpd08:00:541
231359953,2cyclictest25589-21ntp_states12:30:151
231359953,2cyclictest16674-21cat12:10:121
231359952,2cyclictest7669-21sshd11:47:171
231359952,2cyclictest29630-21cut07:25:131
231359952,2cyclictest2587-21file07:37:411
231359952,2cyclictest25595-21seq09:52:041
231359952,2cyclictest14947-21needreboot10:45:141
231359951,3cyclictest27600-21grep12:35:171
231359950,4cyclictest12870-21memory10:40:131
231309955,0cyclictest743-21snmpd12:15:020
231309955,0cyclictest743-21snmpd08:45:000
231309955,0cyclictest5347-21fschecks_time07:45:120
231309954,1cyclictest28355-21fschecks_count08:40:130
231309953,2cyclictest743-21snmpd11:31:080
231309950,4cyclictest18323-21fw_conntrack09:35:150
231439943,1cyclictest743-21snmpd07:56:052
231439943,1cyclictest0-21swapper/211:40:162
231439941,2cyclictest27731-21cut07:20:132
231439941,2cyclictest27466-21sensors11:15:192
231439940,4cyclictest7995-21ntpq07:50:162
231439940,3cyclictest25506-21diskstats07:15:112
231439940,3cyclictest22564-21diskstats11:05:122
231439940,1cyclictest0-21swapper/209:00:142
231359943,1cyclictest0-21swapper/112:15:121
231359941,2cyclictest22499-21ntpq08:25:181
231359941,2cyclictest20607-21latency09:40:121
231359940,3cyclictest5849-21collect207:45:171
231359940,3cyclictest26892-21/usr/sbin/munin08:35:151
231309943,1cyclictest20456-21cpuspeed_turbos11:00:120
231309942,2cyclictest743-21snmpd09:15:010
231309942,2cyclictest557-21NetworkManager08:10:010
231309941,2cyclictest3490-21cut07:40:130
231309940,4cyclictest11908-21ntpq08:00:150
231309940,3cyclictest6418-21fschecks_time11:45:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional