You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-23 - 22:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack8slot6s.osadl.org (updated Mon Mar 23, 2026 12:43:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
18144993232,0cyclictest15192-21fwupd12:17:440
18148991918,1cyclictest65850irq/126-lan08:15:121
18148991818,0cyclictest65850irq/126-lan11:27:001
18148991818,0cyclictest65850irq/126-lan11:20:141
18148991818,0cyclictest65850irq/126-lan08:50:231
18148991817,1cyclictest65850irq/126-lan12:20:191
18148991817,1cyclictest65850irq/126-lan10:05:151
18148991817,1cyclictest65850irq/126-lan08:25:201
18148991717,0cyclictest65850irq/126-lan11:40:121
18148991716,1cyclictest65850irq/126-lan11:45:201
18148991716,1cyclictest65850irq/126-lan11:05:141
18148991716,1cyclictest65850irq/126-lan09:25:201
18148991716,1cyclictest65850irq/126-lan07:20:101
18148991616,0cyclictest65850irq/126-lan11:55:401
18148991616,0cyclictest65850irq/126-lan11:53:271
18148991616,0cyclictest65850irq/126-lan10:55:211
18148991616,0cyclictest65850irq/126-lan10:42:271
18148991616,0cyclictest65850irq/126-lan09:50:181
18148991616,0cyclictest65850irq/126-lan09:15:211
18148991616,0cyclictest65850irq/126-lan09:05:181
18148991616,0cyclictest65850irq/126-lan08:39:511
18148991616,0cyclictest65850irq/126-lan07:40:111
18148991615,1cyclictest65850irq/126-lan12:30:131
18148991615,1cyclictest65850irq/126-lan12:25:191
18148991615,1cyclictest65850irq/126-lan11:30:121
18148991615,1cyclictest65850irq/126-lan10:51:321
18148991615,1cyclictest65850irq/126-lan08:30:171
18148991615,1cyclictest65850irq/126-lan07:55:171
18148991615,1cyclictest65850irq/126-lan07:10:161
18148991515,0cyclictest65850irq/126-lan12:05:111
18148991514,1cyclictest65850irq/126-lan11:15:131
18148991514,1cyclictest65850irq/126-lan10:45:181
18148991514,1cyclictest65850irq/126-lan10:14:271
18148991514,1cyclictest65850irq/126-lan10:00:161
18148991514,1cyclictest65850irq/126-lan09:30:191
18148991514,1cyclictest65850irq/126-lan09:20:121
18148991514,1cyclictest65850irq/126-lan08:45:191
18148991514,1cyclictest65850irq/126-lan08:40:131
18148991514,1cyclictest65850irq/126-lan08:05:171
18148991514,1cyclictest65850irq/126-lan07:45:141
18148991514,1cyclictest65850irq/126-lan07:35:161
18148991414,0cyclictest65850irq/126-lan09:45:201
18148991413,1cyclictest65850irq/126-lan12:35:171
18148991413,1cyclictest65850irq/126-lan11:10:171
18148991413,1cyclictest65850irq/126-lan10:25:181
18148991413,1cyclictest65850irq/126-lan09:40:101
18148991413,1cyclictest65850irq/126-lan08:55:121
18148991413,1cyclictest65850irq/126-lan08:00:201
18148991313,0cyclictest65850irq/126-lan12:10:111
18148991313,0cyclictest65850irq/126-lan09:00:141
18148991312,1cyclictest65850irq/126-lan07:53:271
18148991212,0cyclictest65850irq/126-lan09:55:121
18148991212,0cyclictest65850irq/126-lan09:10:111
18148991111,0cyclictest65850irq/126-lan10:15:111
18148991111,0cyclictest65850irq/126-lan07:30:131
18148991110,1cyclictest65850irq/126-lan12:15:211
18148991110,1cyclictest65850irq/126-lan11:35:181
18148991110,1cyclictest65850irq/126-lan07:19:281
1814899109,1cyclictest65850irq/126-lan12:00:221
1814899109,1cyclictest65850irq/126-lan10:30:151
1814899109,1cyclictest65850irq/126-lan10:20:161
18148991010,0cyclictest65850irq/126-lan11:00:141
18148991010,0cyclictest65850irq/126-lan08:23:261
18148991010,0cyclictest65850irq/126-lan08:10:151
181619998,1cyclictest743-21snmpd11:51:223
181619998,1cyclictest743-21snmpd11:31:093
181619998,1cyclictest741-21lldpd10:57:533
181489999,0cyclictest65850irq/126-lan10:35:201
181449998,1cyclictest743-21snmpd12:00:060
181449998,1cyclictest741-21lldpd09:17:170
181449998,1cyclictest741-21lldpd07:19:330
181619988,0cyclictest743-21snmpd12:18:363
181619988,0cyclictest743-21snmpd09:55:003
181619988,0cyclictest741-21lldpd07:43:323
181619988,0cyclictest741-21lldpd07:19:213
181619987,1cyclictest743-21snmpd12:25:303
181619987,1cyclictest743-21snmpd10:05:343
181619987,1cyclictest743-21snmpd08:25:003
181619987,1cyclictest741-21lldpd10:00:203
181619987,1cyclictest29094-21gltestperf08:55:143
181619986,2cyclictest743-21snmpd11:48:013
181619986,2cyclictest743-21snmpd11:41:013
181619986,2cyclictest743-21snmpd11:17:093
181619986,2cyclictest743-21snmpd09:50:073
181619986,2cyclictest743-21snmpd08:13:543
181619986,2cyclictest743-21snmpd08:08:153
181539988,0cyclictest743-21snmpd10:21:472
181539988,0cyclictest743-21snmpd09:13:472
181539988,0cyclictest741-21lldpd11:02:192
181539988,0cyclictest741-21lldpd07:15:442
181539987,1cyclictest743-21snmpd10:39:532
181539986,2cyclictest743-21snmpd09:36:132
181539986,2cyclictest743-21snmpd08:40:282
181489988,0cyclictest743-21snmpd09:38:581
181449988,0cyclictest743-21snmpd11:36:240
181449988,0cyclictest743-21snmpd11:26:220
181449988,0cyclictest743-21snmpd09:12:200
181449988,0cyclictest741-21lldpd07:48:160
181449988,0cyclictest741-21lldpd07:13:070
181449987,1cyclictest743-21snmpd08:29:150
181449987,1cyclictest522-21avahi-daemon12:30:200
181449987,1cyclictest522-21avahi-daemon10:25:140
181449987,1cyclictest23060-21gltestperf08:40:130
181449986,2cyclictest743-21snmpd12:13:230
181449986,2cyclictest743-21snmpd11:08:500
181449986,2cyclictest743-21snmpd10:47:290
181449986,2cyclictest743-21snmpd09:04:470
181449986,2cyclictest743-21snmpd08:21:160
181449986,2cyclictest743-21snmpd07:38:180
181619977,0cyclictest743-21snmpd11:06:123
181619977,0cyclictest743-21snmpd09:07:173
181619977,0cyclictest743-21snmpd07:31:353
181619977,0cyclictest741-21lldpd10:26:223
181619977,0cyclictest741-21lldpd10:22:393
181619977,0cyclictest741-21lldpd10:15:043
181619977,0cyclictest741-21lldpd09:28:033
181619977,0cyclictest741-21lldpd08:52:493
181619977,0cyclictest741-21lldpd08:16:113
181619976,1cyclictest743-21snmpd11:25:463
181619976,1cyclictest743-21snmpd07:27:103
181619976,1cyclictest741-21lldpd11:13:343
181619976,1cyclictest741-21lldpd10:50:403
181619976,1cyclictest11141-21fschecks_count09:30:123
181619975,2cyclictest743-21snmpd12:32:133
181619975,2cyclictest743-21snmpd11:36:513
181619975,2cyclictest743-21snmpd10:37:053
181619975,2cyclictest743-21snmpd09:23:033
181619975,2cyclictest743-21snmpd09:19:023
181619975,2cyclictest743-21snmpd08:44:043
181619975,2cyclictest743-21snmpd08:23:423
181619975,2cyclictest743-21snmpd07:36:283
181619973,3cyclictest15637-21ntpq11:00:153
181619973,3cyclictest10364-21ntpq12:05:143
181539977,0cyclictest743-21snmpd07:51:532
181539977,0cyclictest741-21lldpd12:35:422
181539976,1cyclictest743-21snmpd10:00:212
181539976,1cyclictest743-21snmpd08:53:022
181539976,1cyclictest522-21avahi-daemon12:08:552
181539976,1cyclictest27404-21gltestperf10:10:132
181539976,1cyclictest19001-21fschecks_time08:30:122
181539975,2cyclictest743-21snmpd12:29:462
181539975,2cyclictest743-21snmpd07:22:282
181539975,2cyclictest743-21snmpd07:14:582
181539973,3cyclictest244-20systemd-journal07:30:142
181449977,0cyclictest743-21snmpd11:52:400
181449977,0cyclictest743-21snmpd11:48:110
181449977,0cyclictest743-21snmpd09:41:030
181449977,0cyclictest743-21snmpd08:03:320
181449977,0cyclictest743-21snmpd07:57:140
181449977,0cyclictest741-21lldpd12:25:580
181449977,0cyclictest741-21lldpd09:59:190
181449977,0cyclictest741-21lldpd08:50:540
181449977,0cyclictest741-21lldpd07:24:280
181449977,0cyclictest522-21avahi-daemon12:21:010
181449976,1cyclictest743-21snmpd11:20:120
181449976,1cyclictest522-21avahi-daemon09:54:460
181449976,1cyclictest522-21avahi-daemon07:32:470
181449976,1cyclictest13050-21cpuspeed_turbos09:35:120
181449975,2cyclictest743-21snmpd09:20:540
181449975,2cyclictest743-21snmpd08:37:410
181449972,4cyclictest743-21snmpd10:55:120
181619966,0cyclictest743-21snmpd08:39:073
181619966,0cyclictest743-21snmpd08:01:303
181619966,0cyclictest743-21snmpd07:47:573
181619966,0cyclictest741-21lldpd09:14:273
181619966,0cyclictest23331-21cut11:20:133
181619965,1cyclictest743-21snmpd10:13:073
181619965,1cyclictest6907-21cpuspeed_turbos10:40:113
181619964,2cyclictest31210-21sed09:00:133
181619963,3cyclictest3623-21ntpq10:30:153
181619962,3cyclictest26039-21sed08:45:223
181539966,0cyclictest741-21lldpd09:25:032
181539966,0cyclictest522-21avahi-daemon09:34:342
181539965,1cyclictest743-21snmpd09:57:062
181539965,1cyclictest21027-21gltestperf08:35:142
181539964,2cyclictest743-21snmpd12:03:422
181539962,3cyclictest244-20systemd-journal08:12:432
181489964,2cyclictest743-21snmpd07:27:161
181449966,0cyclictest741-21lldpd10:15:460
181449965,1cyclictest9295-21cut08:05:170
181449965,1cyclictest743-21snmpd10:05:060
181449965,1cyclictest743-21snmpd09:05:060
181449965,1cyclictest522-21avahi-daemon10:52:380
181449965,1cyclictest10705-21cpuspeed_turbos08:10:100
181449964,2cyclictest743-21snmpd11:31:550
181449964,2cyclictest743-21snmpd11:19:390
181449964,2cyclictest743-21snmpd08:58:310
181449964,2cyclictest743-21snmpd08:33:090
181449964,2cyclictest0-21swapper/010:40:110
181449962,3cyclictest4817-21grep10:35:140
181619955,0cyclictest741-21lldpd12:23:383
181619955,0cyclictest741-21lldpd11:59:293
181619955,0cyclictest522-21avahi-daemon09:49:113
181619955,0cyclictest15437-21cat09:40:133
181619954,1cyclictest741-21lldpd12:02:213
181619954,1cyclictest3370-21ntpq07:50:173
181619953,2cyclictest743-21snmpd12:12:423
181619953,2cyclictest19874-21sshd07:12:273
181619952,3cyclictest544-21systemd-logind08:34:403
181619952,2cyclictest244-20systemd-journal09:35:193
181619951,3cyclictest22973-21df07:20:103
181619950,5cyclictest557-21NetworkManager10:46:233
181539955,0cyclictest743-21snmpd11:38:452
181539955,0cyclictest743-21snmpd07:55:442
181539955,0cyclictest741-21lldpd08:56:032
181539955,0cyclictest522-21avahi-daemon09:47:532
181539955,0cyclictest522-21avahi-daemon08:29:222
181539954,1cyclictest522-21avahi-daemon08:16:282
181539954,1cyclictest13697-21cpuspeed_turbos12:15:132
181539953,2cyclictest743-21snmpd11:33:002
181539953,2cyclictest743-21snmpd09:02:462
181539953,2cyclictest557-21NetworkManager11:17:222
181539953,2cyclictest557-21NetworkManager08:20:132
181539952,3cyclictest19208-21diskstats09:50:132
181539952,2cyclictest575-21rs:main2
181539952,2cyclictest494-21apt-get07:45:122
181539952,2cyclictest4257-21ntpq11:50:172
181539952,2cyclictest244-20systemd-journal11:26:272
181539952,2cyclictest244-20systemd-journal11:20:162
181539952,2cyclictest16227-21sed09:40:202
181539951,3cyclictest21572-21seq12:31:152
181539951,3cyclictest19489-21memory11:10:152
181539951,3cyclictest1533-21dpkg11:45:122
181539951,2cyclictest319-21tr11:40:192
181539950,4cyclictest7557-21ntpq10:40:162
181539950,4cyclictest6310-21ntpq11:55:162
181539950,3cyclictest247492/usr/sbin/munin08:45:192
181539950,2cyclictest445050/usr/sbin/munin09:15:152
181449955,0cyclictest741-21lldpd08:19:200
181449954,1cyclictest743-21snmpd07:42:320
181449953,2cyclictest743-21snmpd11:55:530
181449953,2cyclictest743-21snmpd10:20:400
181449953,2cyclictest743-21snmpd07:50:450
181449953,2cyclictest506-21systemd-resolve12:05:190
181449952,2cyclictest575-21rs:main0
181449951,3cyclictest9114-21diskstats09:25:120
181449951,3cyclictest648-21sed11:40:210
181449951,3cyclictest27273-21diskstats10:10:130
181449951,3cyclictest15938-21grep11:00:180
181449950,4cyclictest23846-21ntpq10:00:160
181619941,2cyclictest4614-21grep07:55:113
181619940,4cyclictest22887-21ntpq12:35:163
181539942,2cyclictest9073-21cat08:05:152
181539942,2cyclictest7484-21ntpq08:00:212
181539942,2cyclictest29591-21grep07:35:172
181539942,2cyclictest11827-21cut12:10:122
181539941,2cyclictest25967-21nvmesmart_nvme010:05:212
181539941,2cyclictest25190-21sed07:25:142
181539941,2cyclictest16667-21grep12:20:172
181539941,2cyclictest1621-21sh10:25:182
181539941,2cyclictest1439-21gzip09:05:202
181539940,4cyclictest7292-21ntpq09:20:172
181539940,4cyclictest29812-21nfs_client10:15:152
181539940,4cyclictest11653-21ntpq10:50:172
181539940,3cyclictest9136-21fw_forwarded_lo10:45:112
181539940,3cyclictest2960-21cat10:30:112
181539940,3cyclictest13038-21diskstats10:55:132
181449943,1cyclictest24904-21cpuspeed_turbos07:25:130
181449941,2cyclictest22539-21smartctl12:35:140
181449941,2cyclictest11848-21open_files09:30:170
181449940,3cyclictest19101-21diskstats11:10:130
181449940,3cyclictest17186-21df_inode09:45:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional