You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-27 - 18:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot6s.osadl.org (updated Thu Nov 27, 2025 12:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
6805994444,0cyclictest3161-21fwupd11:12:193
6805991918,1cyclictest66850irq/125-lan12:24:413
6805991918,1cyclictest66850irq/125-lan11:36:593
6805991918,1cyclictest66850irq/125-lan11:15:163
6805991918,1cyclictest66850irq/125-lan08:40:173
6805991818,0cyclictest66850irq/125-lan11:47:453
6805991818,0cyclictest66850irq/125-lan11:22:273
6805991818,0cyclictest66850irq/125-lan11:02:083
6805991818,0cyclictest66850irq/125-lan10:15:163
6805991818,0cyclictest66850irq/125-lan09:34:023
6805991817,1cyclictest66850irq/125-lan12:27:583
6805991817,1cyclictest66850irq/125-lan12:04:343
6805991817,1cyclictest66850irq/125-lan11:53:073
6805991817,1cyclictest66850irq/125-lan10:30:123
6805991817,1cyclictest66850irq/125-lan10:02:023
6805991817,1cyclictest66850irq/125-lan09:23:193
6800991818,0cyclictest771-21snmpd12:34:022
6800991818,0cyclictest771-21snmpd11:35:392
6800991818,0cyclictest771-21snmpd08:56:372
6800991818,0cyclictest771-21snmpd08:39:542
6805991717,0cyclictest66850irq/125-lan12:37:163
6805991717,0cyclictest66850irq/125-lan12:30:363
6805991717,0cyclictest66850irq/125-lan12:20:013
6805991717,0cyclictest66850irq/125-lan12:09:073
6805991717,0cyclictest66850irq/125-lan10:26:373
6805991717,0cyclictest66850irq/125-lan10:20:243
6805991717,0cyclictest66850irq/125-lan09:50:213
6805991717,0cyclictest66850irq/125-lan09:45:133
6805991717,0cyclictest66850irq/125-lan09:40:343
6805991717,0cyclictest66850irq/125-lan09:27:033
6805991717,0cyclictest66850irq/125-lan09:10:153
6805991716,1cyclictest66850irq/125-lan11:27:163
6805991716,1cyclictest66850irq/125-lan11:08:473
6805991716,1cyclictest66850irq/125-lan10:55:133
6805991716,1cyclictest66850irq/125-lan10:50:123
6805991716,1cyclictest66850irq/125-lan10:45:193
6805991716,1cyclictest66850irq/125-lan10:35:173
6805991716,1cyclictest66850irq/125-lan09:55:583
6805991716,1cyclictest66850irq/125-lan09:35:323
6805991716,1cyclictest66850irq/125-lan07:15:123
6805991715,1cyclictest66850irq/125-lan10:05:053
6805991616,0cyclictest66850irq/125-lan12:10:113
6805991616,0cyclictest66850irq/125-lan11:43:543
6805991616,0cyclictest66850irq/125-lan10:11:473
6805991616,0cyclictest66850irq/125-lan09:17:033
6805991616,0cyclictest66850irq/125-lan08:23:123
6805991616,0cyclictest66850irq/125-lan08:15:143
6805991615,1cyclictest66850irq/125-lan11:33:013
6805991615,1cyclictest66850irq/125-lan09:05:103
6805991615,1cyclictest66850irq/125-lan07:55:123
6805991615,1cyclictest66850irq/125-lan07:28:123
6805991515,0cyclictest66850irq/125-lan11:56:323
6805991514,1cyclictest66850irq/125-lan10:41:473
6805991514,1cyclictest66850irq/125-lan08:30:133
6805991514,1cyclictest66850irq/125-lan08:05:113
6805991514,1cyclictest66850irq/125-lan07:30:163
6805991514,1cyclictest66850irq/125-lan07:10:003
6805991414,0cyclictest66850irq/125-lan07:45:113
6805991414,0cyclictest66850irq/125-lan07:35:163
6805991313,0cyclictest66850irq/125-lan08:47:123
6800991313,0cyclictest771-21snmpd11:19:002
6800991313,0cyclictest771-21snmpd07:26:012
6805991211,1cyclictest66850irq/125-lan08:25:113
6805991111,0cyclictest66850irq/125-lan08:10:143
680599109,1cyclictest66850irq/125-lan08:50:173
680599109,1cyclictest66850irq/125-lan08:00:103
680599109,1cyclictest66850irq/125-lan07:24:473
6805991010,0cyclictest66850irq/125-lan08:55:153
68059999,0cyclictest66850irq/125-lan08:35:503
68009998,1cyclictest769-21lldpd12:15:142
68009998,1cyclictest769-21lldpd10:29:202
68009998,1cyclictest524-21avahi-daemon10:57:022
68009998,1cyclictest524-21avahi-daemon09:31:562
68009996,3cyclictest749-21ntpd09:36:482
67969998,1cyclictest524-21avahi-daemon12:16:391
67969998,1cyclictest524-21avahi-daemon09:27:181
67969998,1cyclictest517-21systemd-resolve10:19:131
67889998,1cyclictest771-21snmpd09:13:100
67889998,1cyclictest769-21lldpd07:12:380
67889998,1cyclictest255-20systemd-journal09:15:560
68059988,0cyclictest771-21snmpd09:04:563
68059988,0cyclictest66850irq/125-lan07:44:123
68009988,0cyclictest771-21snmpd12:35:422
68009988,0cyclictest771-21snmpd11:46:542
68009988,0cyclictest771-21snmpd08:49:232
68009988,0cyclictest771-21snmpd08:40:272
68009987,1cyclictest771-21snmpd11:07:322
68009987,1cyclictest771-21snmpd08:32:312
68009987,1cyclictest769-21lldpd11:26:312
68009987,1cyclictest584-21in:imuxsock10:11:212
68009987,1cyclictest524-21avahi-daemon10:50:052
68009987,1cyclictest255-20systemd-journal12:29:572
68009986,2cyclictest771-21snmpd08:07:512
68009986,2cyclictest749-21ntpd12:20:212
68009986,2cyclictest749-21ntpd12:05:052
68009986,2cyclictest749-21ntpd11:58:242
68009986,2cyclictest749-21ntpd11:40:282
68009986,2cyclictest749-21ntpd11:01:292
68009986,2cyclictest749-21ntpd10:47:392
68009986,2cyclictest749-21ntpd10:15:452
68009986,2cyclictest749-21ntpd09:57:182
68009986,2cyclictest749-21ntpd09:47:112
68009986,2cyclictest749-21ntpd09:25:462
68009986,2cyclictest749-21ntpd09:19:172
68009984,3cyclictest16346-21ntp_states07:30:172
68009984,2cyclictest19594-21grep11:30:142
67969988,0cyclictest771-21snmpd11:26:031
67969988,0cyclictest771-21snmpd11:23:011
67969988,0cyclictest771-21snmpd10:26:371
67969988,0cyclictest771-21snmpd09:50:111
67969988,0cyclictest771-21snmpd09:45:231
67969988,0cyclictest769-21lldpd10:56:391
67969988,0cyclictest769-21lldpd09:05:591
67969988,0cyclictest769-21lldpd08:50:151
67969987,1cyclictest771-21snmpd11:33:421
67969987,1cyclictest769-21lldpd10:31:081
67969987,1cyclictest6568-21idleruntime-cro10:40:011
67969987,1cyclictest524-21avahi-daemon12:12:191
67969987,1cyclictest524-21avahi-daemon11:50:401
67969987,1cyclictest524-21avahi-daemon11:08:341
67969987,1cyclictest16643-21mailstats10:50:191
67969986,2cyclictest771-21snmpd08:07:271
67969986,2cyclictest771-21snmpd07:49:541
67969985,2cyclictest771-21snmpd12:00:461
67889988,0cyclictest771-21snmpd12:00:400
67889988,0cyclictest771-21snmpd11:56:100
67889988,0cyclictest771-21snmpd07:22:520
67889988,0cyclictest769-21lldpd11:46:580
67889988,0cyclictest769-21lldpd11:25:370
67889988,0cyclictest769-21lldpd10:04:240
67889987,1cyclictest771-21snmpd12:24:390
67889987,1cyclictest771-21snmpd10:34:190
67889987,1cyclictest771-21snmpd07:56:470
67889987,1cyclictest769-21lldpd09:57:140
67889987,1cyclictest524-21avahi-daemon11:42:560
67889987,1cyclictest524-21avahi-daemon11:14:260
67889987,1cyclictest19451-21fschecks_count12:05:130
67889986,2cyclictest771-21snmpd12:15:430
67889986,2cyclictest771-21snmpd09:27:020
67889986,2cyclictest771-21snmpd09:08:010
67889986,2cyclictest771-21snmpd07:38:560
67889986,2cyclictest771-21snmpd07:17:190
68059976,1cyclictest66850irq/125-lan07:50:163
68009977,0cyclictest771-21snmpd07:53:562
68009977,0cyclictest771-21snmpd07:22:492
68009977,0cyclictest769-21lldpd10:35:442
68009977,0cyclictest769-21lldpd10:00:102
68009977,0cyclictest769-21lldpd09:14:012
68009976,1cyclictest771-21snmpd08:24:482
68009976,1cyclictest771-21snmpd07:11:332
68009976,1cyclictest749-21ntpd10:21:562
68009976,1cyclictest749-21ntpd10:08:582
68009976,1cyclictest18632-21cat09:40:142
68009975,2cyclictest771-21snmpd10:42:132
68009975,2cyclictest749-21ntpd11:51:252
68009975,2cyclictest749-21ntpd11:20:422
68009975,2cyclictest749-21ntpd11:12:152
68009975,2cyclictest749-21ntpd09:24:402
68009975,2cyclictest749-21ntpd08:00:012
68009975,2cyclictest749-21ntpd07:55:182
68009975,2cyclictest749-21ntpd07:35:202
67969977,0cyclictest771-21snmpd11:40:181
67969977,0cyclictest769-21lldpd12:20:271
67969977,0cyclictest769-21lldpd10:00:341
67969977,0cyclictest769-21lldpd09:44:321
67969977,0cyclictest769-21lldpd07:10:281
67969977,0cyclictest517-21systemd-resolve09:57:371
67969976,1cyclictest864-21gltestperf11:45:141
67969976,1cyclictest771-21snmpd10:41:101
67969976,1cyclictest771-21snmpd08:26:241
67969976,1cyclictest771-21snmpd07:39:201
67969976,1cyclictest771-21snmpd07:29:411
67969976,1cyclictest769-21lldpd10:48:031
67969976,1cyclictest769-21lldpd07:16:161
67969976,1cyclictest517-21systemd-resolve08:19:521
67969976,1cyclictest331ktimers/110:05:161
67969975,2cyclictest771-21snmpd07:57:591
67969973,3cyclictest8901-21forks12:25:111
67969973,3cyclictest14867-21sshd08:46:111
67969972,5cyclictest550-21NetworkManager10:14:491
67889977,0cyclictest771-21snmpd12:29:290
67889977,0cyclictest771-21snmpd11:24:550
67889977,0cyclictest771-21snmpd10:56:080
67889977,0cyclictest771-21snmpd10:26:460
67889977,0cyclictest771-21snmpd08:36:030
67889977,0cyclictest769-21lldpd11:01:290
67889977,0cyclictest769-21lldpd09:44:340
67889977,0cyclictest769-21lldpd09:20:220
67889977,0cyclictest524-21avahi-daemon11:08:230
67889977,0cyclictest524-21avahi-daemon07:25:490
67889976,1cyclictest771-21snmpd08:41:030
67889976,1cyclictest771-21snmpd07:50:140
67889976,1cyclictest524-21avahi-daemon10:54:150
67889976,1cyclictest255-20systemd-journal12:38:160
67889975,2cyclictest771-21snmpd10:20:490
67889975,2cyclictest771-21snmpd10:13:390
67889975,2cyclictest771-21snmpd09:35:320
67889975,2cyclictest771-21snmpd09:00:100
67889974,2cyclictest749-21ntpd10:35:180
67889973,3cyclictest17752-21ssh12:32:410
68009966,0cyclictest771-21snmpd08:50:522
68009966,0cyclictest769-21lldpd12:12:022
68009966,0cyclictest769-21lldpd12:02:242
68009966,0cyclictest769-21lldpd09:00:262
68009966,0cyclictest524-21avahi-daemon08:28:582
68009962,3cyclictest29104-21ssh09:50:322
68009962,3cyclictest1294-21ssh10:33:272
68009961,5cyclictest550-21NetworkManager07:18:512
67969966,0cyclictest769-21lldpd09:00:531
67969965,1cyclictest771-21snmpd11:00:201
67969965,1cyclictest524-21avahi-daemon09:22:261
67969965,1cyclictest3405-21cpuspeed_turbos08:20:101
67969964,2cyclictest550-21NetworkManager09:10:161
67969964,2cyclictest255-20systemd-journal11:10:201
67969964,1cyclictest2693-21kworker/u16:1+nfsiod12:09:361
67969963,2cyclictest586-21rs:main1
67969963,2cyclictest24101-21ssh12:38:001
67969962,4cyclictest550-21NetworkManager09:37:291
67969962,3cyclictest11634-21diskstats07:20:131
67969962,3cyclictest10269-21sed09:30:221
67889966,0cyclictest769-21lldpd11:39:380
67889966,0cyclictest769-21lldpd11:32:430
67889966,0cyclictest524-21avahi-daemon08:20:340
67889965,1cyclictest771-21snmpd10:18:450
67889965,1cyclictest7442-21cpuspeed_turbos08:30:110
67889963,3cyclictest550-21NetworkManager12:13:510
67889963,3cyclictest550-21NetworkManager09:30:390
67889963,2cyclictest586-21rs:main0
68009955,0cyclictest524-21avahi-daemon07:40:132
68009954,1cyclictest21672-21cpuspeed_turbos07:45:112
68009953,2cyclictest771-21snmpd08:12:032
67969955,0cyclictest771-21snmpd07:32:061
67969955,0cyclictest524-21avahi-daemon07:51:531
67969955,0cyclictest0-21swapper/108:43:381
67969954,1cyclictest0-21swapper/108:30:181
67969954,1cyclictest0-21swapper/108:10:121
67969953,2cyclictest11388-21ssh11:56:121
67969952,3cyclictest771-21snmpd12:30:441
67969952,2cyclictest5182-21grep11:15:121
67969952,2cyclictest255-20systemd-journal09:17:041
67969952,2cyclictest24450-21wc11:35:161
67969952,2cyclictest21035-21seq07:41:181
67969952,2cyclictest18544-21cat08:55:201
67969952,2cyclictest10593-21timerwakeupswit08:35:181
67889955,0cyclictest771-21snmpd08:50:220
67889955,0cyclictest769-21lldpd08:28:510
67889955,0cyclictest524-21avahi-daemon08:55:040
67889954,1cyclictest7319-21gltestperf10:40:130
67889954,1cyclictest524-21avahi-daemon09:47:510
67889953,2cyclictest771-21snmpd09:54:100
67889953,2cyclictest31358-21kworker/u16:1+nfsiod10:05:060
67889952,2cyclictest32007-21gltestperf08:10:130
67889952,2cyclictest28234-21sed08:00:130
67889951,3cyclictest6527-21awk11:15:210
67889951,3cyclictest17424-21grep07:35:000
67889950,5cyclictest0-21swapper/008:15:200
67889950,4cyclictest23342-21munin-run07:50:000
68009943,0cyclictest191rcu_preempt08:15:162
68009941,3cyclictest541-21systemd-logind09:06:212
67969940,3cyclictest27655-21apt-get08:00:101
67889941,3cyclictest19651-21sort07:40:140
67889940,4cyclictest11855-21ntpq10:45:180
67889940,3cyclictest775-21runrttasks08:05:240
67889940,3cyclictest14239-21ld08:45:200
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional