You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-15 - 23:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack8slot6s.osadl.org (updated Mon Jun 15, 2026 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22430992019,1cyclictest65850irq/126-lan20:06:433
22430991818,0cyclictest65850irq/126-lan23:40:153
22430991817,1cyclictest65850irq/126-lan23:10:103
22430991817,1cyclictest65850irq/126-lan21:20:093
22430991817,1cyclictest65850irq/126-lan19:20:153
22430991717,0cyclictest65850irq/126-lan22:20:183
22430991717,0cyclictest65850irq/126-lan20:45:353
22430991717,0cyclictest65850irq/126-lan20:35:333
22430991717,0cyclictest65850irq/126-lan00:15:133
22430991716,1cyclictest65850irq/126-lan23:15:163
22430991716,1cyclictest65850irq/126-lan22:55:173
22430991716,1cyclictest65850irq/126-lan22:02:343
22430991716,1cyclictest65850irq/126-lan21:30:173
22430991716,1cyclictest65850irq/126-lan21:10:183
22430991716,1cyclictest65850irq/126-lan21:00:133
22430991716,1cyclictest65850irq/126-lan19:34:393
22430991715,1cyclictest65850irq/126-lan20:20:173
22430991616,0cyclictest65850irq/126-lan23:20:123
22430991616,0cyclictest65850irq/126-lan22:35:113
22430991616,0cyclictest65850irq/126-lan22:32:333
22430991616,0cyclictest65850irq/126-lan00:30:133
22430991616,0cyclictest65850irq/126-lan00:27:343
22430991615,1cyclictest65850irq/126-lan23:35:173
22430991615,1cyclictest65850irq/126-lan23:30:133
22430991615,1cyclictest65850irq/126-lan23:05:183
22430991615,1cyclictest65850irq/126-lan22:15:143
22430991615,1cyclictest65850irq/126-lan21:50:343
22430991615,1cyclictest65850irq/126-lan21:45:153
22430991615,1cyclictest65850irq/126-lan21:40:173
22430991615,1cyclictest65850irq/126-lan20:30:143
22430991615,1cyclictest65850irq/126-lan19:35:173
22430991515,0cyclictest65850irq/126-lan23:55:013
22430991515,0cyclictest65850irq/126-lan21:35:133
22430991514,1cyclictest65850irq/126-lan22:45:143
22430991514,1cyclictest65850irq/126-lan22:05:343
22430991514,1cyclictest65850irq/126-lan22:05:333
22430991514,1cyclictest65850irq/126-lan20:50:133
22430991514,1cyclictest65850irq/126-lan19:55:223
22430991514,1cyclictest65850irq/126-lan19:50:153
22430991514,1cyclictest65850irq/126-lan00:05:133
22430991414,0cyclictest65850irq/126-lan20:59:353
22430991414,0cyclictest65850irq/126-lan20:02:353
22430991414,0cyclictest65850irq/126-lan00:10:343
22430991413,1cyclictest65850irq/126-lan23:00:153
22430991413,1cyclictest65850irq/126-lan22:50:173
22430991413,1cyclictest65850irq/126-lan21:55:193
22430991413,1cyclictest65850irq/126-lan21:25:143
22430991413,1cyclictest65850irq/126-lan19:10:173
22430991313,0cyclictest65850irq/126-lan23:45:353
22430991313,0cyclictest65850irq/126-lan19:45:213
22430991312,1cyclictest65850irq/126-lan20:10:133
22430991212,0cyclictest65850irq/126-lan21:15:143
22430991212,0cyclictest65850irq/126-lan00:20:173
22430991211,1cyclictest65850irq/126-lan22:25:163
22430991211,1cyclictest65850irq/126-lan19:40:163
22430991211,1cyclictest65850irq/126-lan19:25:563
22430991111,0cyclictest65850irq/126-lan23:25:113
22430991111,0cyclictest65850irq/126-lan20:25:183
22430991111,0cyclictest65850irq/126-lan19:15:123
22430991110,1cyclictest65850irq/126-lan21:05:163
22430991110,1cyclictest65850irq/126-lan20:40:133
22430991110,1cyclictest65850irq/126-lan00:00:143
2243099109,1cyclictest65850irq/126-lan23:50:133
2243099109,1cyclictest65850irq/126-lan22:41:293
2243099109,1cyclictest65850irq/126-lan20:15:153
22426991010,0cyclictest743-21snmpd23:39:162
224269998,1cyclictest743-21snmpd20:47:382
224269998,1cyclictest743-21snmpd19:42:182
224269997,1cyclictest743-21snmpd22:15:172
224209998,1cyclictest743-21snmpd21:29:111
224129998,1cyclictest743-21snmpd22:43:090
224129998,1cyclictest743-21snmpd19:58:450
224129998,1cyclictest743-21snmpd19:50:090
224309988,0cyclictest65850irq/126-lan00:35:203
224269988,0cyclictest743-21snmpd23:13:522
224269988,0cyclictest743-21snmpd21:01:302
224269988,0cyclictest743-21snmpd20:03:372
224269988,0cyclictest741-21lldpd23:46:022
224269988,0cyclictest741-21lldpd22:59:382
224269988,0cyclictest741-21lldpd19:36:382
224269988,0cyclictest741-21lldpd00:02:352
224269987,1cyclictest743-21snmpd21:06:442
224269987,1cyclictest743-21snmpd19:23:382
224269987,1cyclictest741-21lldpd20:28:462
224269987,1cyclictest741-21lldpd19:58:392
224269987,1cyclictest741-21lldpd00:11:452
224269986,2cyclictest743-21snmpd23:53:072
224269986,2cyclictest743-21snmpd22:26:532
224269986,2cyclictest743-21snmpd21:26:392
224269986,2cyclictest743-21snmpd20:35:462
224269986,2cyclictest743-21snmpd20:19:042
224269986,2cyclictest743-21snmpd20:06:242
224269986,2cyclictest743-21snmpd19:53:542
224269986,2cyclictest743-21snmpd19:11:562
224269986,2cyclictest743-21snmpd00:37:032
224269985,3cyclictest743-21snmpd20:31:442
224209988,0cyclictest743-21snmpd20:25:431
224209988,0cyclictest741-21lldpd23:53:341
224209988,0cyclictest741-21lldpd21:49:131
224209988,0cyclictest741-21lldpd00:15:551
224209987,0cyclictest191rcu_preempt20:30:231
224209986,2cyclictest743-21snmpd22:23:461
224209986,2cyclictest6790-21cat19:50:141
224129988,0cyclictest743-21snmpd23:40:100
224129988,0cyclictest743-21snmpd21:09:030
224129988,0cyclictest741-21lldpd23:25:560
224129988,0cyclictest741-21lldpd20:05:580
224129988,0cyclictest741-21lldpd19:41:280
224129988,0cyclictest741-21lldpd19:14:210
224129987,1cyclictest743-21snmpd23:19:070
224129987,1cyclictest743-21snmpd21:34:520
224129987,1cyclictest741-21lldpd21:43:000
224129986,2cyclictest743-21snmpd19:33:390
224129986,2cyclictest10844-21cat20:00:150
224269977,0cyclictest743-21snmpd23:56:442
224269977,0cyclictest743-21snmpd22:22:012
224269977,0cyclictest743-21snmpd22:14:082
224269977,0cyclictest743-21snmpd21:12:122
224269977,0cyclictest743-21snmpd00:32:122
224269977,0cyclictest741-21lldpd23:26:022
224269977,0cyclictest741-21lldpd21:37:402
224269976,1cyclictest743-21snmpd23:24:362
224269976,1cyclictest743-21snmpd21:41:362
224269976,1cyclictest741-21lldpd22:48:322
224269976,1cyclictest506-21systemd-resolve00:25:182
224269975,2cyclictest743-21snmpd19:26:362
224209977,0cyclictest743-21snmpd22:50:111
224209977,0cyclictest743-21snmpd19:24:291
224209977,0cyclictest741-21lldpd23:49:451
224209977,0cyclictest741-21lldpd21:33:271
224209977,0cyclictest741-21lldpd20:50:251
224209977,0cyclictest15488-21needreboot20:10:141
224209976,1cyclictest743-21snmpd23:36:281
224209976,1cyclictest743-21snmpd20:35:311
224209976,1cyclictest741-21lldpd20:47:361
224209976,0cyclictest191rcu_preempt22:25:201
224209975,2cyclictest743-21snmpd19:56:581
224209975,2cyclictest743-21snmpd00:23:081
224209974,2cyclictest7109-21apt-get21:10:111
224209974,2cyclictest13183-21sshd22:44:351
224209973,3cyclictest30841-21df19:30:131
224209973,2cyclictest34-21ksoftirqd/122:30:191
224209973,2cyclictest34-21ksoftirqd/100:05:161
224209973,2cyclictest24270-21gcc00:30:161
224209972,2cyclictest19978-21wc20:20:191
224209972,2cyclictest18069-21memory22:55:151
224209971,4cyclictest34-21ksoftirqd/121:15:121
224209971,3cyclictest34-21ksoftirqd/123:15:141
224129977,0cyclictest743-21snmpd23:05:030
224129977,0cyclictest743-21snmpd22:49:480
224129977,0cyclictest741-21lldpd23:59:450
224129977,0cyclictest741-21lldpd23:49:090
224129977,0cyclictest741-21lldpd23:20:470
224129977,0cyclictest741-21lldpd22:21:240
224129977,0cyclictest741-21lldpd21:29:420
224129977,0cyclictest741-21lldpd20:55:570
224129977,0cyclictest522-21avahi-daemon20:20:440
224129976,1cyclictest741-21lldpd22:00:330
224129975,2cyclictest743-21snmpd22:19:110
224129975,2cyclictest743-21snmpd22:12:350
224129975,2cyclictest743-21snmpd21:54:040
224129975,2cyclictest743-21snmpd21:20:120
224129975,2cyclictest743-21snmpd20:48:380
224129975,2cyclictest743-21snmpd19:37:320
224129975,2cyclictest743-21snmpd00:37:520
224129975,2cyclictest743-21snmpd00:05:390
224269966,0cyclictest743-21snmpd23:00:092
224269966,0cyclictest743-21snmpd22:40:272
224269966,0cyclictest743-21snmpd22:31:472
224269966,0cyclictest743-21snmpd21:53:432
224269966,0cyclictest743-21snmpd21:20:442
224269966,0cyclictest743-21snmpd20:42:592
224269966,0cyclictest743-21snmpd19:31:392
224269966,0cyclictest741-21lldpd23:19:182
224269966,0cyclictest522-21avahi-daemon00:05:292
224269965,1cyclictest743-21snmpd23:30:462
224269965,1cyclictest743-21snmpd21:45:252
224269965,1cyclictest5021-21cut19:45:172
224269964,2cyclictest15616-21cat21:30:152
224269960,5cyclictest25440-21diskstats21:55:112
224209966,0cyclictest743-21snmpd22:15:141
224209966,0cyclictest741-21lldpd23:57:151
224209966,0cyclictest741-21lldpd22:06:431
224209966,0cyclictest741-21lldpd22:06:421
224209966,0cyclictest741-21lldpd21:04:441
224209965,1cyclictest4652-21gltestperf19:45:151
224209965,1cyclictest12165-21apt-get20:05:011
224209965,0cyclictest191rcu_preempt23:40:141
224209965,0cyclictest191rcu_preempt22:45:121
224209965,0cyclictest191rcu_preempt22:36:131
224209965,0cyclictest191rcu_preempt21:43:181
224209965,0cyclictest191rcu_preempt20:06:391
224209965,0cyclictest191rcu_preempt00:25:401
224209965,0cyclictest191rcu_preempt00:10:161
224209964,0cyclictest191rcu_preempt23:00:191
224209964,0cyclictest191rcu_preempt21:23:191
224209963,2cyclictest2770-21cat19:40:141
224209963,0cyclictest191rcu_preempt23:07:331
224209962,4cyclictest557-21NetworkManager00:01:301
224209961,2cyclictest34-21ksoftirqd/120:15:181
224209960,2cyclictest24369-21awk21:50:211
224129966,0cyclictest743-21snmpd19:47:180
224129966,0cyclictest741-21lldpd21:19:220
224129966,0cyclictest741-21lldpd20:31:040
224129966,0cyclictest741-21lldpd00:29:220
224129966,0cyclictest741-21lldpd00:20:410
224129966,0cyclictest522-21avahi-daemon00:04:560
224129964,2cyclictest743-21snmpd22:52:350
224129963,3cyclictest557-21NetworkManager23:32:350
224129963,3cyclictest557-21NetworkManager22:30:180
224129962,3cyclictest31581-21sed20:50:140
224269955,0cyclictest743-21snmpd23:05:062
224269955,0cyclictest743-21snmpd20:50:012
224269955,0cyclictest743-21snmpd19:16:532
224269955,0cyclictest522-21avahi-daemon22:00:562
224269954,1cyclictest0-21swapper/220:20:132
224269953,2cyclictest743-21snmpd22:05:562
224269953,2cyclictest743-21snmpd22:05:552
224269952,2cyclictest10323-21unixbench_multi22:35:192
224269950,4cyclictest15767-21perl22:50:122
224209955,0cyclictest741-21lldpd19:35:141
224209955,0cyclictest27700-21cpuspeed_turbos23:20:111
224209954,0cyclictest191rcu_preempt20:55:011
224209954,0cyclictest191rcu_preempt20:44:111
224209954,0cyclictest191rcu_preempt19:10:131
224209953,2cyclictest717-21ntpd19:15:091
224209953,2cyclictest5096-21apt-get21:05:111
224209953,0cyclictest191rcu_preempt23:25:121
224209952,3cyclictest32153-21sed23:30:131
224209951,3cyclictest34-21ksoftirqd/121:55:121
224209951,3cyclictest17362-21df_inode21:35:131
224209951,2cyclictest34-21ksoftirqd/123:10:101
224209951,1cyclictest27417-21grep22:00:111
224209950,3cyclictest34-21ksoftirqd/122:10:211
224209950,2cyclictest34-21ksoftirqd/100:35:121
224129955,0cyclictest741-21lldpd21:36:030
224129955,0cyclictest741-21lldpd19:23:520
224129955,0cyclictest522-21avahi-daemon19:28:330
224129953,2cyclictest743-21snmpd23:50:560
224129953,2cyclictest21670-21cat21:45:160
224129953,0cyclictest0-21swapper/022:08:230
224129953,0cyclictest0-21swapper/022:08:220
224129952,3cyclictest557-21NetworkManager20:11:580
224129952,2cyclictest9374-21sed22:35:110
224129952,2cyclictest575-21rs:main0
224129952,2cyclictest24047-21sed00:30:140
224129951,3cyclictest25760-21sed19:15:210
224129951,3cyclictest21215-21grep20:25:130
224129950,5cyclictest5728-21ntpq22:25:160
224129950,4cyclictest1985-21ntpq23:35:150
224129950,4cyclictest18203-21ntpq00:15:170
224269943,1cyclictest421ktimers/223:40:142
224269943,1cyclictest14989-21tr20:10:112
224269942,2cyclictest717-21ntpd00:20:082
224269941,2cyclictest2556-21sshd20:57:102
224269941,2cyclictest10973-21cat21:20:012
224269940,3cyclictest17599-21df00:15:132
224129942,2cyclictest743-21snmpd21:10:080
224129942,2cyclictest557-21NetworkManager20:35:000
224129942,2cyclictest26964-21find20:40:110
224129942,2cyclictest19694-21grep23:00:110
224129941,3cyclictest17697-21ldconfig20:15:190
224129941,2cyclictest3149-21grep21:00:130
224129941,2cyclictest24096-21wc23:10:130
224129941,2cyclictest16190-21ld00:10:180
224129940,4cyclictest18276-21ntpq22:55:170
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional