You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-10 - 09:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Wed Dec 10, 2025 00:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3525991918,1cyclictest66850irq/125-lan23:45:141
3525991918,1cyclictest66850irq/125-lan22:56:151
3525991918,1cyclictest66850irq/125-lan22:23:581
3525991918,1cyclictest66850irq/125-lan22:15:011
3525991918,1cyclictest66850irq/125-lan22:00:141
3525991918,1cyclictest66850irq/125-lan21:30:191
3525991918,1cyclictest66850irq/125-lan21:25:161
3525991918,1cyclictest66850irq/125-lan21:20:171
3530991816,2cyclictest771-21snmpd21:55:072
3525991818,0cyclictest66850irq/125-lan23:10:011
3525991818,0cyclictest66850irq/125-lan22:50:161
3525991818,0cyclictest66850irq/125-lan22:08:131
3525991818,0cyclictest66850irq/125-lan21:50:171
3525991817,1cyclictest66850irq/125-lan23:53:461
3525991817,1cyclictest66850irq/125-lan23:41:591
3525991817,1cyclictest66850irq/125-lan23:35:181
3525991817,1cyclictest66850irq/125-lan23:05:161
3525991817,1cyclictest66850irq/125-lan22:31:111
3525991817,1cyclictest66850irq/125-lan22:31:111
3525991817,1cyclictest66850irq/125-lan22:10:331
3525991817,1cyclictest66850irq/125-lan21:38:561
3525991817,1cyclictest66850irq/125-lan21:15:141
3525991817,1cyclictest66850irq/125-lan21:13:271
3525991817,1cyclictest66850irq/125-lan21:00:161
3525991817,1cyclictest66850irq/125-lan20:20:041
3525991817,1cyclictest66850irq/125-lan00:30:211
3525991817,1cyclictest66850irq/125-lan00:05:211
3525991817,1cyclictest66850irq/125-lan00:00:041
3525991717,0cyclictest66850irq/125-lan23:59:071
3525991717,0cyclictest66850irq/125-lan23:28:041
3525991717,0cyclictest66850irq/125-lan23:17:541
3525991717,0cyclictest66850irq/125-lan22:39:251
3525991717,0cyclictest66850irq/125-lan22:25:181
3525991717,0cyclictest66850irq/125-lan21:47:291
3525991717,0cyclictest66850irq/125-lan20:15:161
3525991717,0cyclictest66850irq/125-lan00:35:491
3525991717,0cyclictest66850irq/125-lan00:12:531
3525991716,1cyclictest66850irq/125-lan23:20:171
3525991716,1cyclictest66850irq/125-lan23:01:131
3525991716,1cyclictest66850irq/125-lan22:45:051
3525991716,1cyclictest66850irq/125-lan21:55:191
3525991716,1cyclictest66850irq/125-lan21:40:211
3525991716,1cyclictest66850irq/125-lan20:40:151
3525991716,1cyclictest66850irq/125-lan19:30:201
3525991716,1cyclictest66850irq/125-lan00:15:241
3525991616,0cyclictest66850irq/125-lan20:05:221
3525991616,0cyclictest66850irq/125-lan00:20:461
3525991615,1cyclictest66850irq/125-lan23:31:411
3525991615,1cyclictest66850irq/125-lan22:40:161
3525991615,1cyclictest66850irq/125-lan20:30:171
3525991615,1cyclictest66850irq/125-lan20:25:231
3525991615,1cyclictest66850irq/125-lan20:00:211
3525991615,1cyclictest66850irq/125-lan19:20:181
3525991615,1cyclictest66850irq/125-lan19:17:001
3525991615,1cyclictest66850irq/125-lan00:25:151
3525991515,0cyclictest66850irq/125-lan20:35:141
3525991514,1cyclictest66850irq/125-lan20:55:161
3525991514,1cyclictest66850irq/125-lan20:50:201
3525991414,0cyclictest66850irq/125-lan20:45:191
3525991414,0cyclictest66850irq/125-lan20:11:451
3525991414,0cyclictest66850irq/125-lan19:47:401
3525991414,0cyclictest66850irq/125-lan19:36:401
3525991413,1cyclictest66850irq/125-lan21:05:131
3517991412,2cyclictest771-21snmpd00:35:180
3525991313,0cyclictest66850irq/125-lan19:50:271
3525991312,1cyclictest66850irq/125-lan19:10:141
3525991211,1cyclictest66850irq/125-lan19:41:391
3525991110,1cyclictest66850irq/125-lan19:26:411
35349998,1cyclictest771-21snmpd21:47:153
35349998,1cyclictest771-21snmpd00:28:593
35349998,1cyclictest769-21lldpd20:26:523
35349998,1cyclictest524-21avahi-daemon22:53:303
35349998,0cyclictest771-21snmpd22:20:493
35309998,1cyclictest771-21snmpd19:10:572
35309998,1cyclictest524-21avahi-daemon22:46:552
35179998,1cyclictest524-21avahi-daemon22:03:350
35349988,0cyclictest771-21snmpd21:57:483
35349988,0cyclictest771-21snmpd19:49:143
35349988,0cyclictest771-21snmpd19:35:343
35349988,0cyclictest771-21snmpd00:00:223
35349988,0cyclictest769-21lldpd22:11:023
35349988,0cyclictest769-21lldpd00:39:083
35349988,0cyclictest769-21lldpd00:31:113
35349988,0cyclictest769-21lldpd00:06:303
35349987,1cyclictest771-21snmpd20:23:333
35349987,1cyclictest590-21gmain21:30:003
35349987,1cyclictest524-21avahi-daemon22:42:373
35349987,1cyclictest524-21avahi-daemon21:05:183
35349987,1cyclictest524-21avahi-daemon20:15:213
35349987,1cyclictest524-21avahi-daemon00:11:243
35349986,2cyclictest771-21snmpd23:27:483
35349986,2cyclictest771-21snmpd20:01:173
35309988,0cyclictest771-21snmpd23:55:252
35309988,0cyclictest771-21snmpd23:11:572
35309988,0cyclictest771-21snmpd22:40:172
35309988,0cyclictest771-21snmpd22:35:432
35309988,0cyclictest771-21snmpd22:01:512
35309988,0cyclictest771-21snmpd21:21:082
35309988,0cyclictest771-21snmpd19:36:132
35309988,0cyclictest771-21snmpd19:23:012
35309988,0cyclictest771-21snmpd00:30:412
35309988,0cyclictest769-21lldpd23:34:582
35309988,0cyclictest769-21lldpd20:39:452
35309988,0cyclictest769-21lldpd20:21:222
35309988,0cyclictest769-21lldpd20:10:142
35309988,0cyclictest769-21lldpd20:05:562
35309988,0cyclictest769-21lldpd19:19:492
35309988,0cyclictest769-21lldpd00:05:252
35309987,1cyclictest524-21avahi-daemon23:20:172
35309986,2cyclictest771-21snmpd22:18:222
35309986,2cyclictest771-21snmpd21:43:032
35309983,3cyclictest14749-21cat22:35:002
35309983,3cyclictest14749-21cat22:35:002
35259987,1cyclictest769-21lldpd19:56:241
35179988,0cyclictest771-21snmpd20:08:470
35179988,0cyclictest771-21snmpd19:13:020
35179988,0cyclictest771-21snmpd00:06:560
35179988,0cyclictest769-21lldpd22:43:580
35179987,1cyclictest771-21snmpd23:02:410
35179987,1cyclictest769-21lldpd22:46:100
35179987,1cyclictest769-21lldpd21:27:190
35179987,1cyclictest524-21avahi-daemon21:49:050
35179987,1cyclictest524-21avahi-daemon19:40:100
35179986,2cyclictest771-21snmpd23:45:010
35179986,2cyclictest771-21snmpd23:39:490
35179986,2cyclictest771-21snmpd22:35:130
35179986,2cyclictest771-21snmpd00:21:200
35349977,0cyclictest771-21snmpd23:03:053
35349977,0cyclictest771-21snmpd21:33:173
35349977,0cyclictest771-21snmpd21:15:533
35349977,0cyclictest771-21snmpd20:57:343
35349977,0cyclictest771-21snmpd20:47:103
35349977,0cyclictest769-21lldpd22:17:543
35349977,0cyclictest769-21lldpd22:09:483
35349977,0cyclictest769-21lldpd22:04:423
35349977,0cyclictest769-21lldpd21:50:503
35349977,0cyclictest524-21avahi-daemon21:37:083
35349976,1cyclictest771-21snmpd21:43:513
35349976,1cyclictest769-21lldpd21:13:073
35349976,1cyclictest6394-21gltestperf23:55:173
35349976,1cyclictest524-21avahi-daemon23:43:423
35349976,1cyclictest524-21avahi-daemon20:35:133
35349976,1cyclictest524-21avahi-daemon00:23:413
35349976,1cyclictest517-21systemd-resolve23:21:513
35349976,1cyclictest16298-21gltestperf23:35:153
35349976,1cyclictest15217-21latency_hist23:35:003
35349975,2cyclictest771-21snmpd19:53:413
35309977,0cyclictest771-21snmpd22:14:262
35309977,0cyclictest771-21snmpd20:53:552
35309977,0cyclictest769-21lldpd23:45:412
35309977,0cyclictest769-21lldpd22:59:442
35309977,0cyclictest769-21lldpd21:17:452
35309976,1cyclictest9996-21cpuspeed_turbos23:00:132
35309976,1cyclictest769-21lldpd22:06:142
35309976,1cyclictest524-21avahi-daemon21:32:262
35309976,1cyclictest517-21systemd-resolve21:45:252
35309976,1cyclictest517-21systemd-resolve19:34:292
35309976,1cyclictest24625-21gltestperf20:00:162
35309975,2cyclictest771-21snmpd00:21:262
35309975,2cyclictest15335-21grep21:35:152
35309973,3cyclictest11224-21ssh00:00:072
35179977,0cyclictest771-21snmpd22:28:580
35179977,0cyclictest771-21snmpd22:10:130
35179977,0cyclictest769-21lldpd23:34:400
35179977,0cyclictest769-21lldpd21:38:190
35179977,0cyclictest769-21lldpd21:05:430
35179977,0cyclictest769-21lldpd20:42:170
35179977,0cyclictest769-21lldpd20:10:410
35179977,0cyclictest769-21lldpd19:55:330
35179977,0cyclictest769-21lldpd19:25:180
35179976,1cyclictest771-21snmpd21:54:120
35179976,1cyclictest771-21snmpd20:32:450
35179976,1cyclictest771-21snmpd20:02:590
35179976,1cyclictest771-21snmpd19:48:110
35179975,2cyclictest771-21snmpd22:55:060
35179975,2cyclictest20387-21diskmemload21:41:370
35179974,2cyclictest586-21rs:main0
35179973,3cyclictest9132-21ssh23:29:300
35179973,3cyclictest3804-21ssh23:52:350
35179973,3cyclictest24649-21ssh23:13:520
35179973,3cyclictest14079-21ssh22:34:130
35179973,3cyclictest14079-21ssh22:34:130
35349966,0cyclictest771-21snmpd22:26:113
35349966,0cyclictest771-21snmpd19:26:403
35349966,0cyclictest769-21lldpd23:14:103
35349966,0cyclictest769-21lldpd22:36:013
35349966,0cyclictest769-21lldpd22:34:083
35349966,0cyclictest769-21lldpd22:34:083
35349966,0cyclictest769-21lldpd20:43:493
35349966,0cyclictest769-21lldpd20:31:123
35349965,1cyclictest771-21snmpd23:46:133
35349965,1cyclictest771-21snmpd20:14:473
35349964,2cyclictest771-21snmpd23:05:113
35349964,2cyclictest771-21snmpd19:23:423
35349964,2cyclictest771-21snmpd00:16:353
35349963,2cyclictest3057-21ssh23:51:393
35349962,3cyclictest7629-21ssh22:57:283
35309966,0cyclictest9394-21dump-pmu-power22:30:002
35309966,0cyclictest771-21snmpd20:43:152
35309966,0cyclictest769-21lldpd21:13:312
35309965,1cyclictest771-21snmpd23:39:222
35309965,1cyclictest64-21kcompactd023:40:182
35309965,1cyclictest31406-21cpuspeed_turbos22:50:122
35309965,1cyclictest255-20systemd-journal00:19:202
35309965,1cyclictest13563-21fschecks_count00:35:142
35309964,2cyclictest26361-21cat23:15:152
35309964,2cyclictest16615-21sed19:40:152
35309964,1cyclictest771-21snmpd21:25:352
35309963,3cyclictest550-21NetworkManager23:29:452
35309963,2cyclictest255-20systemd-journal00:26:362
35309963,2cyclictest2032-21ssh22:23:122
35179966,0cyclictest769-21lldpd20:50:430
35179966,0cyclictest584-21in:imuxsock20:28:450
35179965,1cyclictest584-21in:imuxsock22:24:390
35179965,1cyclictest21335-21cpuspeed_turbos00:10:140
35179965,1cyclictest171ktimers/021:12:150
35179964,2cyclictest30796-21cat20:15:190
35179963,3cyclictest550-21NetworkManager23:56:210
35179963,3cyclictest550-21NetworkManager22:50:310
35179963,3cyclictest550-21NetworkManager21:23:240
35179963,3cyclictest12826-21sensors_temp19:30:200
35179963,3cyclictest10015-21fw_packets21:30:140
35179963,2cyclictest24155-21ssh23:41:570
35179962,3cyclictest7894-21ssh00:29:220
35179962,3cyclictest6880-21ssh21:57:230
35179962,3cyclictest32694-21fw_forwarded_lo20:20:140
35179962,3cyclictest31178-21ssh21:19:570
35179962,3cyclictest27705-21ssh22:16:300
35179962,3cyclictest18163-21sh22:08:300
35349955,0cyclictest769-21lldpd22:47:143
35349955,0cyclictest769-21lldpd19:15:173
35349955,0cyclictest524-21avahi-daemon19:11:203
35349954,1cyclictest584-21in:imuxsock21:21:123
35349954,1cyclictest16063-21fschecks_time19:40:123
35349953,2cyclictest771-21snmpd20:50:013
35349953,2cyclictest12744-21wc19:30:183
35349952,3cyclictest255-20systemd-journal19:55:013
35349952,2cyclictest27627-21grep20:05:223
35309955,0cyclictest771-21snmpd21:05:012
35309955,0cyclictest524-21avahi-daemon21:01:142
35309955,0cyclictest524-21avahi-daemon19:46:552
35309955,0cyclictest524-21avahi-daemon19:27:422
35309955,0cyclictest15304-21cpuspeed_turbos23:05:122
35309954,1cyclictest421ktimers/221:50:162
35309953,2cyclictest771-21snmpd20:28:542
35309953,2cyclictest10531-21cat20:45:162
35309951,3cyclictest21234-21cat00:10:122
35309950,2cyclictest207050ssh23:50:242
35179955,0cyclictest771-21snmpd19:53:500
35179955,0cyclictest769-21lldpd23:20:460
35179954,1cyclictest769-21lldpd20:38:590
35179954,1cyclictest255-20systemd-journal21:01:220
35179953,2cyclictest771-21snmpd23:05:180
35179952,3cyclictest8055-21perl19:20:130
35179952,3cyclictest11586-21sshd20:46:500
35179952,2cyclictest6005-21grep19:15:150
35179952,2cyclictest25874-21ssh23:15:110
35179952,2cyclictest14054-21tune2fs19:35:140
35179952,2cyclictest11982-21rm00:33:220
35179950,4cyclictest12748-21users00:00:210
35349942,2cyclictest550-21NetworkManager23:15:133
35349941,2cyclictest16275-21cut21:00:133
35309943,1cyclictest19930-21cpuspeed_turbos19:50:122
35309942,2cyclictest771-21snmpd20:30:032
35309942,2cyclictest22629-21ntpq19:55:162
35309941,3cyclictest31412-21wc20:15:252
35309940,4cyclictest14981-21ntp_states20:55:202
35179940,3cyclictest14127-21apt20:55:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional