You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-07 - 12:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot6s.osadl.org (updated Sun Dec 07, 2025 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
665993838,0cyclictest1350-21fwupd23:07:191
665992019,1cyclictest66850irq/125-lan21:05:181
665991919,0cyclictest66850irq/125-lan22:22:021
665991918,1cyclictest66850irq/125-lan23:26:041
665991918,1cyclictest66850irq/125-lan22:40:151
665991918,1cyclictest66850irq/125-lan21:18:371
665991918,1cyclictest66850irq/125-lan00:14:231
665991918,1cyclictest66850irq/125-lan00:06:321
665991918,1cyclictest66850irq/125-lan00:00:131
665991818,0cyclictest66850irq/125-lan23:35:131
665991818,0cyclictest66850irq/125-lan23:22:111
665991818,0cyclictest66850irq/125-lan22:27:561
665991818,0cyclictest66850irq/125-lan22:07:451
665991818,0cyclictest66850irq/125-lan21:47:561
665991818,0cyclictest66850irq/125-lan21:40:171
665991818,0cyclictest66850irq/125-lan21:38:201
665991817,1cyclictest8774-21kworker/1:0+events19:17:231
665991817,1cyclictest66850irq/125-lan23:01:591
665991817,1cyclictest66850irq/125-lan22:12:361
665991817,1cyclictest66850irq/125-lan21:55:151
665991817,1cyclictest66850irq/125-lan19:50:131
665991817,1cyclictest66850irq/125-lan00:34:081
665991717,0cyclictest66850irq/125-lan23:55:511
665991717,0cyclictest66850irq/125-lan23:30:461
665991717,0cyclictest66850irq/125-lan21:12:511
665991717,0cyclictest66850irq/125-lan20:37:521
665991716,1cyclictest66850irq/125-lan23:45:141
665991716,1cyclictest66850irq/125-lan23:10:191
665991716,1cyclictest66850irq/125-lan22:50:161
665991716,1cyclictest66850irq/125-lan22:45:131
665991716,1cyclictest66850irq/125-lan22:30:161
665991716,1cyclictest66850irq/125-lan22:18:571
665991716,1cyclictest66850irq/125-lan22:00:191
665991716,1cyclictest66850irq/125-lan21:32:001
665991716,1cyclictest66850irq/125-lan21:27:311
665991716,1cyclictest66850irq/125-lan21:20:121
665991716,1cyclictest66850irq/125-lan20:25:131
665991716,1cyclictest66850irq/125-lan00:35:141
665991716,1cyclictest66850irq/125-lan00:28:051
665991716,1cyclictest66850irq/125-lan00:24:331
665991616,0cyclictest66850irq/125-lan23:50:161
665991616,0cyclictest66850irq/125-lan22:55:161
665991616,0cyclictest66850irq/125-lan19:45:161
665991616,0cyclictest66850irq/125-lan00:15:361
665991615,1cyclictest66850irq/125-lan23:40:131
665991615,1cyclictest66850irq/125-lan23:15:361
665991615,1cyclictest66850irq/125-lan22:36:121
665991615,1cyclictest66850irq/125-lan21:53:091
675991514,1cyclictest771-21snmpd00:18:513
665991515,0cyclictest66850irq/125-lan20:20:191
665991515,0cyclictest66850irq/125-lan19:55:191
665991515,0cyclictest66850irq/125-lan19:25:141
665991514,1cyclictest66850irq/125-lan21:00:181
665991514,1cyclictest66850irq/125-lan19:20:211
665991414,0cyclictest66850irq/125-lan20:58:431
665991414,0cyclictest66850irq/125-lan20:18:021
665991414,0cyclictest66850irq/125-lan19:10:121
665991413,1cyclictest66850irq/125-lan20:45:201
665991413,1cyclictest66850irq/125-lan19:35:151
659991412,2cyclictest771-21snmpd23:31:370
675991313,0cyclictest771-21snmpd20:22:073
675991313,0cyclictest771-21snmpd19:10:163
675991312,1cyclictest749-21ntpd00:11:183
665991312,1cyclictest66850irq/125-lan20:30:211
675991212,0cyclictest771-21snmpd20:35:433
665991212,0cyclictest66850irq/125-lan20:40:211
665991212,0cyclictest66850irq/125-lan20:05:131
665991212,0cyclictest66850irq/125-lan19:30:141
665991211,1cyclictest66850irq/125-lan20:00:181
665991111,0cyclictest66850irq/125-lan20:50:231
675991010,0cyclictest771-21snmpd23:38:023
675991010,0cyclictest771-21snmpd21:49:013
675991010,0cyclictest771-21snmpd20:47:203
665991010,0cyclictest66850irq/125-lan20:12:321
665991010,0cyclictest66850irq/125-lan19:40:201
6759999,0cyclictest771-21snmpd22:47:333
6759999,0cyclictest771-21snmpd00:07:333
6759999,0cyclictest21960-21cat22:55:143
6759998,1cyclictest769-21lldpd00:36:593
6759998,1cyclictest20091-21fschecks_count19:55:143
6709998,1cyclictest771-21snmpd21:43:222
6709998,1cyclictest769-21lldpd21:54:302
6709996,3cyclictest771-21snmpd23:51:052
6599998,1cyclictest771-21snmpd20:36:280
6759988,0cyclictest771-21snmpd23:46:503
6759988,0cyclictest771-21snmpd23:02:453
6759988,0cyclictest771-21snmpd22:53:273
6759988,0cyclictest771-21snmpd22:42:183
6759988,0cyclictest771-21snmpd22:23:563
6759988,0cyclictest771-21snmpd21:50:253
6759988,0cyclictest771-21snmpd21:37:273
6759988,0cyclictest771-21snmpd21:13:123
6759988,0cyclictest771-21snmpd20:15:253
6759988,0cyclictest771-21snmpd00:23:213
6759988,0cyclictest769-21lldpd22:08:263
6759988,0cyclictest769-21lldpd21:01:333
6759988,0cyclictest769-21lldpd20:56:473
6759988,0cyclictest769-21lldpd19:30:163
6759988,0cyclictest6124-21cat20:40:183
6759988,0cyclictest5912-21cat21:30:173
6759988,0cyclictest3874-21cat23:10:153
6759988,0cyclictest32426-21cat20:25:153
6759987,1cyclictest771-21snmpd23:21:433
6759987,1cyclictest771-21snmpd22:25:383
6759987,1cyclictest524-21avahi-daemon22:12:593
6759987,1cyclictest517-21systemd-resolve21:59:373
6759986,2cyclictest771-21snmpd22:38:483
6759986,2cyclictest749-21ntpd23:58:203
6759986,2cyclictest749-21ntpd22:00:183
6759986,2cyclictest749-21ntpd00:31:033
6709988,0cyclictest771-21snmpd23:19:312
6709988,0cyclictest771-21snmpd22:49:212
6709988,0cyclictest771-21snmpd21:45:162
6709988,0cyclictest771-21snmpd21:32:482
6709988,0cyclictest769-21lldpd20:14:012
6709987,1cyclictest771-21snmpd00:31:422
6709987,1cyclictest771-21snmpd00:29:362
6709987,1cyclictest769-21lldpd23:03:152
6709987,1cyclictest769-21lldpd21:12:202
6709987,1cyclictest517-21systemd-resolve23:21:232
6709986,2cyclictest771-21snmpd22:50:422
6709986,2cyclictest771-21snmpd21:06:202
6709986,2cyclictest771-21snmpd00:15:152
6709986,2cyclictest16124-21cat23:55:132
6599988,0cyclictest771-21snmpd21:51:070
6599988,0cyclictest771-21snmpd20:42:270
6599988,0cyclictest771-21snmpd20:30:040
6599988,0cyclictest771-21snmpd19:37:080
6599988,0cyclictest769-21lldpd22:12:260
6599988,0cyclictest769-21lldpd21:16:580
6599988,0cyclictest769-21lldpd00:14:080
6599988,0cyclictest17898-21apt-key23:25:000
6599987,1cyclictest771-21snmpd21:05:110
6599987,1cyclictest542-21thermald00:00:000
6599987,1cyclictest524-21avahi-daemon22:28:280
6599987,1cyclictest517-21systemd-resolve23:15:320
6599987,1cyclictest16015-21gltestperf23:55:130
6599986,2cyclictest771-21snmpd23:25:500
6599986,2cyclictest771-21snmpd22:15:350
6599986,2cyclictest771-21snmpd21:44:280
6599986,2cyclictest771-21snmpd20:08:390
6599986,2cyclictest771-21snmpd19:50:570
6599986,2cyclictest14295-21cat19:40:160
6759977,0cyclictest771-21snmpd22:16:383
6759977,0cyclictest771-21snmpd20:10:573
6759977,0cyclictest769-21lldpd23:40:463
6759977,0cyclictest769-21lldpd20:53:523
6759977,0cyclictest769-21lldpd19:40:523
6759977,0cyclictest769-21lldpd00:25:303
6759976,1cyclictest769-21lldpd22:33:433
6759976,1cyclictest15165-21fschecks_time21:40:143
6759975,2cyclictest771-21snmpd23:05:003
6759975,2cyclictest771-21snmpd19:28:203
6759975,2cyclictest749-21ntpd23:27:163
6759973,3cyclictest15158-21ssh23:54:503
6709977,0cyclictest771-21snmpd22:26:052
6709977,0cyclictest771-21snmpd21:56:312
6709977,0cyclictest771-21snmpd21:21:242
6709977,0cyclictest771-21snmpd20:32:222
6709977,0cyclictest771-21snmpd19:25:232
6709977,0cyclictest771-21snmpd00:21:122
6709977,0cyclictest769-21lldpd22:42:232
6709977,0cyclictest769-21lldpd22:16:292
6709977,0cyclictest769-21lldpd21:25:102
6709977,0cyclictest769-21lldpd20:52:232
6709977,0cyclictest524-21avahi-daemon21:17:172
6709976,1cyclictest771-21snmpd23:47:082
6709976,1cyclictest771-21snmpd23:37:112
6709976,1cyclictest771-21snmpd23:27:342
6709976,1cyclictest771-21snmpd22:12:292
6709976,1cyclictest771-21snmpd00:04:122
6709976,1cyclictest769-21lldpd21:39:062
6709976,1cyclictest14431-21fschecks_time21:00:152
6709975,2cyclictest771-21snmpd23:32:132
6709975,2cyclictest771-21snmpd22:06:252
6709975,2cyclictest771-21snmpd20:15:012
6599977,0cyclictest771-21snmpd22:52:300
6599977,0cyclictest771-21snmpd22:22:020
6599977,0cyclictest771-21snmpd21:58:330
6599977,0cyclictest771-21snmpd21:14:140
6599977,0cyclictest769-21lldpd21:24:400
6599976,1cyclictest771-21snmpd19:33:170
6599976,1cyclictest524-21avahi-daemon22:48:420
6599976,1cyclictest517-21systemd-resolve23:02:360
6599976,1cyclictest2116-21cut22:00:180
6599976,1cyclictest19676-21cpuspeed_turbos21:45:120
6599975,2cyclictest771-21snmpd20:02:240
6599975,2cyclictest11237-21cat23:50:150
6599974,2cyclictest255-20systemd-journal23:13:050
6599973,4cyclictest550-21NetworkManager22:30:380
6599973,3cyclictest255-20systemd-journal19:21:430
6759965,1cyclictest771-21snmpd21:23:363
6759964,2cyclictest771-21snmpd19:49:393
6759963,3cyclictest25669-21ssh23:31:553
6759963,2cyclictest24139-21ntpq21:15:183
6759962,3cyclictest2427-21ssh21:25:563
6709966,0cyclictest771-21snmpd23:41:502
6709966,0cyclictest771-21snmpd20:41:012
6709966,0cyclictest771-21snmpd20:00:272
6709966,0cyclictest771-21snmpd19:57:152
6709965,1cyclictest771-21snmpd20:26:552
6709965,1cyclictest255-20systemd-journal22:55:142
6709964,2cyclictest771-21snmpd22:02:342
6709962,3cyclictest582-21sh22:33:252
6709962,3cyclictest12985-21ntp_states20:55:192
6709962,3cyclictest1045-21diskstats19:10:132
6709960,1cyclictest30833-21ntpq20:20:182
6599966,0cyclictest771-21snmpd21:38:090
6599966,0cyclictest771-21snmpd20:16:220
6599966,0cyclictest769-21lldpd23:45:500
6599966,0cyclictest769-21lldpd00:09:060
6599965,1cyclictest8510-21fschecks_time00:20:140
6599965,1cyclictest771-21snmpd22:05:040
6599965,1cyclictest584-21in:imuxsock22:55:220
6599964,2cyclictest771-21snmpd19:19:020
6599963,2cyclictest6166-21ssh00:17:250
6599963,2cyclictest586-21rs:main0
6599963,2cyclictest32658-21ssh23:39:500
6599963,2cyclictest255-20systemd-journal21:30:070
6599962,4cyclictest550-21NetworkManager20:27:450
6599962,3cyclictest22826-21ssh00:35:430
6599962,3cyclictest19955-21ssh00:33:240
6599962,3cyclictest14462-21fw_packets21:00:150
6599960,6cyclictest1221-21apt-get23:40:120
6759955,0cyclictest501rcuc/321:10:003
6759954,1cyclictest584-21in:imuxsock19:17:093
6759954,1cyclictest0-21swapper/300:00:173
6759953,2cyclictest64-21kcompactd019:20:163
6759952,3cyclictest24358-21cat20:05:153
6759952,2cyclictest8106-21ssh23:15:123
6759952,2cyclictest12064-21grep19:35:133
6709955,0cyclictest771-21snmpd23:07:432
6709955,0cyclictest771-21snmpd19:35:162
6709955,0cyclictest769-21lldpd19:41:542
6709954,1cyclictest771-21snmpd19:24:582
6709954,1cyclictest584-21in:imuxsock00:12:022
6709953,2cyclictest771-21snmpd19:46:292
6709953,2cyclictest550-21NetworkManager20:07:342
6709952,2cyclictest5119-21ssh23:10:462
6709952,2cyclictest3194-21dpkg19:15:002
6709952,2cyclictest2348-21ssh22:35:032
6709951,3cyclictest28479-21ssh00:07:352
6709950,4cyclictest4382-21ntpq20:35:162
6599955,0cyclictest26610-21needreboot20:10:190
6599954,1cyclictest771-21snmpd20:47:050
6599954,1cyclictest15934-21cpuspeed_turbos19:45:130
6599953,2cyclictest771-21snmpd19:58:380
6599953,2cyclictest771-21snmpd19:29:410
6599952,3cyclictest30587-21sed20:20:160
6599952,3cyclictest13191-21sed20:55:210
6599952,2cyclictest2285-21awk22:35:010
6599952,2cyclictest1722-21ldconfig19:10:170
6599951,3cyclictest11088-21ssh22:44:170
6599950,3cyclictest17927-21diskmemload23:05:080
6599950,3cyclictest17927-21diskmemload21:26:140
6759941,2cyclictest22135-21cut20:00:153
6759941,2cyclictest17856-21cat19:50:123
6759940,4cyclictest2480-21ntp_states20:30:203
6709941,2cyclictest8247-21wc20:45:182
6709941,2cyclictest21205-21ld22:20:202
6709941,2cyclictest17884-21grep19:50:132
6709940,4cyclictest21352-21cut00:35:122
6709940,3cyclictest10098-21fw_forwarded_lo19:30:152
6599942,2cyclictest771-21snmpd20:50:170
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional