You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-08-27 - 09:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot4s.osadl.org (updated Wed Aug 27, 2025 00:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8087102236169,21sleep40-21swapper/419:05:324
8065772234170,21sleep30-21swapper/319:05:073
8087152227166,47sleep00-21swapper/019:05:360
8087482219154,52sleep60-21swapper/619:06:066
8087402218184,22sleep70-21swapper/719:05:597
8088412214161,42sleep20-21swapper/219:07:232
8089832211180,20sleep50-21swapper/519:09:275
8088132205177,18sleep10-21swapper/119:06:561
8231002490,0sleep30-21swapper/319:30:223
809251993028,1cyclictest964829-21fwupd23:37:535
80924099280,23cyclictest0-21swapper/219:15:002
80924099280,22cyclictest0-21swapper/223:25:162
809237992813,14cyclictest0-21swapper/121:45:181
809237992813,14cyclictest0-21swapper/121:45:181
80924099271,22cyclictest821719-21apt-get19:30:142
80925599260,21cyclictest0-21swapper/623:20:016
809240992623,2cyclictest0-21swapper/220:00:132
809240992621,4cyclictest0-21swapper/220:50:002
809251992522,2cyclictest896311-21apt-get21:40:175
80924099250,24cyclictest0-21swapper/221:30:002
80924099250,24cyclictest0-21swapper/220:05:152
80924099250,0cyclictest0-21swapper/219:50:132
80925599240,21cyclictest0-21swapper/619:15:146
809246992421,2cyclictest1896684-21systemd-journal22:55:004
80924199240,23cyclictest0-21swapper/320:55:003
809240992422,2cyclictest0-21swapper/220:55:132
809240992420,3cyclictest829879-21munin-run19:45:002
809237992424,0cyclictest0-21swapper/100:35:121
80923799240,23cyclictest0-21swapper/123:35:011
80925799230,22cyclictest0-21swapper/723:50:007
80925599230,2cyclictest844174-21awk20:10:006
80925599230,22cyclictest0-21swapper/623:05:016
80925599230,22cyclictest0-21swapper/620:15:016
80925599230,0cyclictest0-21swapper/620:55:126
80925599230,0cyclictest0-21swapper/620:40:126
809251992323,0cyclictest0-21swapper/521:20:135
80924699230,22cyclictest959040-21awk23:30:014
809241992321,1cyclictest0-21swapper/323:10:173
809241992321,1cyclictest0-21swapper/322:30:223
809241992321,1cyclictest0-21swapper/322:10:123
809241992321,1cyclictest0-21swapper/320:55:123
80924199230,22cyclictest809560-21apt-get19:10:123
80924199230,22cyclictest0-21swapper/300:00:003
80924199230,1cyclictest902018-21apt-get21:50:173
80924199230,1cyclictest902018-21apt-get21:50:163
809240992321,1cyclictest994636-21apt-get00:30:142
80924099230,22cyclictest952065-21ntpq23:15:212
80924099230,22cyclictest864443-21munin-run20:45:002
80924099230,22cyclictest0-21swapper/219:35:142
809237992323,0cyclictest0-21swapper/119:15:001
809237992320,2cyclictest878716-21idleruntime-cro21:10:001
809237992318,4cyclictest1896684-21systemd-journal20:40:001
80923799230,22cyclictest0-21swapper/123:30:011
80923799230,22cyclictest0-21swapper/121:40:171
80923799230,1cyclictest0-21swapper/122:40:001
80923599230,22cyclictest0-21swapper/020:45:160
80923599230,22cyclictest0-21swapper/019:35:140
80923599230,21cyclictest0-21swapper/000:40:000
809257992221,1cyclictest0-21swapper/722:55:127
809257992221,1cyclictest0-21swapper/722:20:007
80925799220,21cyclictest0-21swapper/723:30:017
80925799220,21cyclictest0-21swapper/721:40:177
80925799220,21cyclictest0-21swapper/720:30:137
80925799220,21cyclictest0-21swapper/720:15:157
809255992221,1cyclictest921887-21idleruntime-cro22:25:006
80925599220,21cyclictest0-21swapper/622:25:146
80925599220,1cyclictest933308-21munin-run22:45:006
80925599220,1cyclictest910593-21apt-get22:05:146
809251992221,1cyclictest939010-21munin-run22:55:005
809251992221,0cyclictest0-21swapper/519:30:145
809251992220,1cyclictest818445-21munin-run19:25:005
80925199220,21cyclictest970736-21awk23:50:005
80925199220,1cyclictest991522-21apt-get00:25:145
80925199220,1cyclictest925147-21apt-get22:30:155
80925199220,1cyclictest899158-21apt-get21:45:125
80925199220,1cyclictest899158-21apt-get21:45:125
809246992222,0cyclictest0-21swapper/400:20:014
80924699220,21cyclictest939428-21apt-get22:55:124
80924699220,21cyclictest893436-21apt-get21:35:164
80924699220,21cyclictest0-21swapper/423:30:124
80924699220,21cyclictest0-21swapper/423:20:184
80924699220,1cyclictest965455-21apt-get23:40:174
80924199220,21cyclictest0-21swapper/321:10:133
80924199220,21cyclictest0-21swapper/319:55:143
80924199220,21cyclictest0-21swapper/319:35:143
80924199220,21cyclictest0-21swapper/319:20:123
80924199220,1cyclictest999929-21perf00:40:003
809240992222,0cyclictest0-21swapper/221:15:152
809240992221,1cyclictest818863-21apt-get19:25:132
809240992221,1cyclictest0-21swapper/221:50:172
809240992221,1cyclictest0-21swapper/221:50:172
809240992221,1cyclictest0-21swapper/220:50:142
809240992221,1cyclictest0-21swapper/220:20:002
809240992220,1cyclictest0-21swapper/219:55:142
809240992219,3cyclictest0-21swapper/221:55:142
80924099220,21cyclictest0-21swapper/222:05:002
80924099220,21cyclictest0-21swapper/221:00:142
809237992222,0cyclictest0-21swapper/121:20:131
809237992221,1cyclictest0-21swapper/120:55:121
809237992221,1cyclictest0-21swapper/119:20:131
809237992220,1cyclictest991522-21apt-get00:25:141
809237992219,2cyclictest838433-21sendmail19:59:591
80923799220,21cyclictest0-21swapper/122:15:131
809235992221,0cyclictest0-21swapper/019:30:140
809235992220,1cyclictest862009-21apt-get20:40:120
80923599220,21cyclictest0-21swapper/023:45:180
80923599220,21cyclictest0-21swapper/023:20:180
80923599220,21cyclictest0-21swapper/023:05:150
80923599220,21cyclictest0-21swapper/019:10:110
80923599220,1cyclictest0-21swapper/021:05:140
809257992120,1cyclictest930433-21sendmail22:40:007
809257992120,1cyclictest0-21swapper/723:55:147
80925799210,0cyclictest0-21swapper/719:25:137
809255992121,0cyclictest0-21swapper/619:40:136
809255992120,1cyclictest985530-21apt-get00:15:136
809255992120,1cyclictest0-21swapper/623:35:136
809255992120,1cyclictest0-21swapper/621:15:156
809255992120,1cyclictest0-21swapper/621:00:146
809255992119,1cyclictest913443-21apt-get22:10:126
809255992119,1cyclictest0-21swapper/621:20:126
80925599210,21cyclictest811995-21munin-run19:15:006
80925599210,20cyclictest0-21swapper/621:35:166
80925599210,20cyclictest0-21swapper/621:10:136
80925599210,1cyclictest956594-21apt-get23:25:166
80925599210,0cyclictest0-21swapper/620:30:126
809251992121,0cyclictest0-21swapper/521:30:125
809251992120,1cyclictest947591-21munin-run23:10:015
80925199210,20cyclictest0-21swapper/520:05:155
80925199210,1cyclictest0-21swapper/500:00:005
80925199210,0cyclictest0-21swapper/522:20:155
809246992120,1cyclictest0-21swapper/422:25:004
809246992119,1cyclictest0-21swapper/421:00:004
80924699210,20cyclictest0-21swapper/421:50:174
80924699210,20cyclictest0-21swapper/421:50:174
80924699210,1cyclictest0-21swapper/423:40:014
80924699210,0cyclictest0-21swapper/400:10:134
809241992120,1cyclictest859142-21apt-get20:35:183
809241992120,1cyclictest0-21swapper/322:05:143
809241992120,0cyclictest0-21swapper/323:25:153
809241992120,0cyclictest0-21swapper/320:45:163
809241992119,1cyclictest907741-21apt-get22:00:153
809241992119,1cyclictest813136-21apt-get19:15:143
80924199210,20cyclictest0-21swapper/320:10:163
80924199210,20cyclictest0-21swapper/300:20:123
80924199210,0cyclictest0-21swapper/323:45:183
80924199210,0cyclictest0-21swapper/323:20:183
80924199210,0cyclictest0-21swapper/323:05:153
809240992121,0cyclictest0-21swapper/220:25:132
809240992120,1cyclictest650-21dbus-daemon00:20:002
80924099210,20cyclictest0-21swapper/200:10:132
80924099210,0cyclictest0-21swapper/221:45:122
80924099210,0cyclictest0-21swapper/221:45:122
809237992121,0cyclictest0-21swapper/122:50:131
809237992121,0cyclictest0-21swapper/122:40:181
809237992121,0cyclictest0-21swapper/122:20:141
809237992121,0cyclictest0-21swapper/119:40:131
809237992121,0cyclictest0-21swapper/119:30:141
809237992120,1cyclictest0-21swapper/121:10:131
80923799210,0cyclictest0-21swapper/100:10:131
809235992121,0cyclictest0-21swapper/022:10:120
809235992120,1cyclictest0-21swapper/000:10:130
809235992120,0cyclictest0-21swapper/020:55:120
809257992020,0cyclictest0-21swapper/723:35:137
809257992020,0cyclictest0-21swapper/722:30:167
809257992020,0cyclictest0-21swapper/721:45:127
809257992020,0cyclictest0-21swapper/721:45:127
809257992020,0cyclictest0-21swapper/720:50:147
809257992020,0cyclictest0-21swapper/719:20:137
809257992020,0cyclictest0-21swapper/700:25:007
809257992020,0cyclictest0-21swapper/700:10:137
809257992019,1cyclictest841732-21apt-get20:05:157
809257992019,1cyclictest0-21swapper/722:25:147
809257992019,1cyclictest0-21swapper/720:35:187
80925599206,13cyclictest0-21swapper/620:20:146
809255992020,0cyclictest0-21swapper/622:35:146
809255992020,0cyclictest0-21swapper/621:50:176
809255992020,0cyclictest0-21swapper/621:50:176
809255992020,0cyclictest0-21swapper/600:20:126
809255992019,1cyclictest994636-21apt-get00:30:146
809255992019,1cyclictest0-21swapper/622:55:126
809255992018,2cyclictest976499-21date00:00:006
80925599200,19cyclictest0-21swapper/622:15:136
809251992020,0cyclictest0-21swapper/520:59:595
809251992020,0cyclictest0-21swapper/520:35:185
809251992019,1cyclictest0-21swapper/500:20:135
80925199200,0cyclictest0-21swapper/520:15:155
80925199200,0cyclictest0-21swapper/520:15:005
809246992020,0cyclictest0-21swapper/422:15:004
809246992020,0cyclictest0-21swapper/421:45:124
809246992020,0cyclictest0-21swapper/421:45:124
809246992020,0cyclictest0-21swapper/419:45:154
809246992020,0cyclictest0-21swapper/419:35:144
809246992020,0cyclictest0-21swapper/400:30:024
809246992019,1cyclictest0-21swapper/419:30:004
809246992019,1cyclictest0-21swapper/400:05:134
809246992012,4cyclictest0-21swapper/420:50:004
80924699200,0cyclictest0-21swapper/419:20:134
809241992020,0cyclictest0-21swapper/323:35:133
809241992020,0cyclictest0-21swapper/320:40:113
809241992020,0cyclictest0-21swapper/300:10:133
809241992019,1cyclictest0-21swapper/322:40:173
809241992018,1cyclictest0-21swapper/321:00:143
809241992018,1cyclictest0-21swapper/300:30:023
80924199200,1cyclictest930435-21munin-run22:40:003
80924199200,0cyclictest0-21swapper/320:20:143
809240992020,0cyclictest0-21swapper/223:55:122
809240992020,0cyclictest0-21swapper/223:35:022
809240992020,0cyclictest0-21swapper/223:10:172
809240992020,0cyclictest0-21swapper/222:25:142
809240992020,0cyclictest0-21swapper/220:10:152
809240992019,1cyclictest0-21swapper/222:30:162
809240992018,1cyclictest936168-21turbostat22:50:002
809240992015,4cyclictest878726-21munin-run21:10:002
809237992020,0cyclictest0-21swapper/123:40:171
809237992020,0cyclictest0-21swapper/122:10:121
809237992020,0cyclictest0-21swapper/120:05:151
809237992020,0cyclictest0-21swapper/100:20:121
809237992020,0cyclictest0-21swapper/100:15:131
809237992019,1cyclictest1-21systemd20:15:001
809237992019,1cyclictest0-21swapper/100:30:021
809235992020,0cyclictest0-21swapper/023:35:020
809235992020,0cyclictest0-21swapper/023:10:170
809235992020,0cyclictest0-21swapper/022:30:220
809235992020,0cyclictest0-21swapper/021:10:130
809235992020,0cyclictest0-21swapper/020:50:130
809235992020,0cyclictest0-21swapper/020:20:140
809235992020,0cyclictest0-21swapper/020:15:010
809235992020,0cyclictest0-21swapper/020:10:160
809235992020,0cyclictest0-21swapper/000:20:120
80923599200,19cyclictest0-21swapper/022:40:000
80923599200,0cyclictest0-21swapper/000:00:000
809257991919,0cyclictest0-21swapper/723:30:127
809257991919,0cyclictest0-21swapper/721:55:147
809257991919,0cyclictest0-21swapper/721:20:137
809257991919,0cyclictest0-21swapper/720:10:167
809257991919,0cyclictest0-21swapper/719:35:147
809257991919,0cyclictest0-21swapper/719:10:127
809257991918,1cyclictest0-21swapper/722:45:137
809257991917,1cyclictest873044-21basename21:00:007
809255991919,0cyclictest0-21swapper/623:20:186
809255991919,0cyclictest0-21swapper/622:30:166
809255991919,0cyclictest0-21swapper/622:00:146
809255991919,0cyclictest0-21swapper/621:55:146
809255991919,0cyclictest0-21swapper/620:25:136
809255991919,0cyclictest0-21swapper/620:10:166
809255991919,0cyclictest0-21swapper/619:35:006
809255991918,1cyclictest0-21swapper/620:45:166
809255991917,2cyclictest0-21swapper/620:50:146
80925599190,18cyclictest887727-21apt-get21:25:146
809251991919,0cyclictest0-21swapper/519:15:145
809251991918,1cyclictest927998-21apt-get22:35:135
809251991918,1cyclictest0-21swapper/522:15:145
809251991918,1cyclictest0-21swapper/500:30:215
809251991917,1cyclictest856282-21apt-get20:30:135
809251991916,3cyclictest967902-21awk23:45:005
809246991919,0cyclictest0-21swapper/423:50:134
809246991919,0cyclictest0-21swapper/419:10:124
809246991917,1cyclictest876294-21apt-get21:05:144
809241991918,1cyclictest847007-21apt-get20:15:003
809241991918,1cyclictest0-21swapper/323:40:173
809241991918,1cyclictest0-21swapper/319:50:003
809241991918,0cyclictest0-21swapper/300:25:133
809241991917,1cyclictest0-21swapper/320:00:133
809241991917,1cyclictest0-21swapper/319:40:133
809240991919,0cyclictest0-21swapper/221:35:152
809240991919,0cyclictest0-21swapper/200:35:132
809240991918,1cyclictest0-21swapper/220:20:132
809237991919,0cyclictest0-21swapper/119:35:141
809237991918,1cyclictest933725-21apt-get22:45:131
809235991919,0cyclictest0-21swapper/023:25:160
809235991919,0cyclictest0-21swapper/022:05:140
809235991919,0cyclictest0-21swapper/020:35:180
809235991918,0cyclictest0-21swapper/019:15:140
809235991917,1cyclictest979827-21apt-get00:05:130
809235991917,1cyclictest0-21swapper/021:30:120
809235991917,1cyclictest0-21swapper/019:50:000
809257991818,0cyclictest950864-21apt-get23:15:167
809257991818,0cyclictest827447-21apt-get19:40:137
809257991818,0cyclictest0-21swapper/700:30:017
809257991817,1cyclictest813136-21apt-get19:15:147
809257991817,1cyclictest0-21swapper/721:50:177
809257991817,1cyclictest0-21swapper/721:50:177
80925799180,17cyclictest0-21swapper/720:45:177
809255991818,0cyclictest0-21swapper/623:50:136
809255991818,0cyclictest0-21swapper/623:10:186
809255991817,1cyclictest0-21swapper/600:00:136
80925599181,3cyclictest965423-21/usr/sbin/munin23:40:236
809251991816,1cyclictest976973-21apt-get00:00:135
809246991818,0cyclictest0-21swapper/423:15:164
809246991818,0cyclictest0-21swapper/422:00:154
809246991818,0cyclictest0-21swapper/421:40:174
809246991818,0cyclictest0-21swapper/421:25:144
809246991818,0cyclictest0-21swapper/421:10:134
809246991818,0cyclictest0-21swapper/420:10:164
809246991817,1cyclictest0-21swapper/423:10:014
809246991817,1cyclictest0-21swapper/420:40:124
809246991816,1cyclictest958649-21avahi-daemon00:00:134
809246991816,1cyclictest875874-21munin-run21:05:004
80924699180,17cyclictest933326-21basename22:45:004
809241991818,0cyclictest0-21swapper/323:15:163
809241991818,0cyclictest0-21swapper/321:40:173
809241991818,0cyclictest0-21swapper/321:30:123
809241991818,0cyclictest0-21swapper/300:05:133
809241991817,1cyclictest853431-21apt-get20:25:133
809241991817,0cyclictest0-21swapper/323:50:133
809241991817,0cyclictest0-21swapper/322:25:143
809241991816,1cyclictest979412-21perf00:05:003
809241991816,1cyclictest0-21swapper/323:00:133
809240991818,0cyclictest0-21swapper/219:15:142
809240991817,1cyclictest0-21swapper/223:30:132
809240991817,0cyclictest0-21swapper/221:10:132
80924099180,17cyclictest0-21swapper/223:48:302
80924099180,17cyclictest0-21swapper/222:50:132
80924099180,15cyclictest0-21swapper/221:30:292
80924099180,0cyclictest0-21swapper/223:05:152
809237991818,0cyclictest0-21swapper/100:05:131
809235991818,0cyclictest0-21swapper/022:00:140
809235991817,1cyclictest0-21swapper/021:40:170
809235991817,1cyclictest0-21swapper/021:00:140
809235991817,1cyclictest0-21swapper/000:30:130
809235991817,0cyclictest0-21swapper/023:15:150
809235991817,0cyclictest0-21swapper/022:40:180
809257991717,0cyclictest0-21swapper/721:05:147
809257991716,1cyclictest0-21swapper/700:40:007
809255991717,0cyclictest0-21swapper/600:10:136
809255991716,1cyclictest0-21swapper/620:35:186
809255991714,3cyclictest0-21swapper/600:35:196
809255991713,4cyclictest0-21swapper/619:50:136
809255991712,4cyclictest827007-21munin-run19:39:596
809251991717,0cyclictest0-21swapper/523:30:015
809251991717,0cyclictest0-21swapper/519:25:135
809251991715,1cyclictest982679-21apt-get00:10:125
809251991715,1cyclictest867715-21apt-get20:50:145
809251991715,1cyclictest850578-21apt-get20:20:145
809246991717,0cyclictest0-21swapper/422:30:164
809246991717,0cyclictest0-21swapper/420:38:364
809246991717,0cyclictest0-21swapper/420:30:124
809246991717,0cyclictest0-21swapper/419:40:134
809241991717,0cyclictest0-21swapper/322:55:123
809240991716,1cyclictest913443-21apt-get22:10:122
809240991714,2cyclictest0-21swapper/222:09:052
809240991713,3cyclictest0-21swapper/223:22:042
80924099170,17cyclictest0-21swapper/223:53:482
80924099170,16cyclictest940714-21ntp_states22:55:182
80924099170,16cyclictest0-21swapper/223:40:352
80924099170,16cyclictest0-21swapper/223:03:192
80924099170,16cyclictest0-21swapper/221:23:442
80924099170,16cyclictest0-21swapper/220:36:562
80924099170,16cyclictest0-21swapper/220:30:132
80924099170,16cyclictest0-21swapper/219:49:342
80924099170,16cyclictest0-21swapper/200:25:492
80924099170,14cyclictest0-21swapper/222:40:492
809237991717,0cyclictest0-21swapper/122:55:121
809237991717,0cyclictest0-21swapper/122:05:141
809237991717,0cyclictest0-21swapper/121:30:121
809237991717,0cyclictest0-21swapper/121:25:141
809237991716,1cyclictest0-21swapper/121:05:001
809237991716,1cyclictest0-21swapper/100:00:121
809235991717,0cyclictest0-21swapper/023:40:170
809235991717,0cyclictest0-21swapper/000:25:130
809235991716,1cyclictest0-21swapper/022:55:120
80923599170,1cyclictest0-21swapper/022:20:010
809257991616,0cyclictest948014-21apt-get23:10:187
809257991615,1cyclictest0-21swapper/723:05:157
80925599163,1cyclictest0-21swapper/619:45:226
809255991614,2cyclictest838878-21apt-get20:00:136
809255991614,2cyclictest0-21swapper/619:57:426
809255991614,2cyclictest0-21swapper/600:25:456
809255991613,2cyclictest0-21swapper/621:30:126
80925599160,1cyclictest0-21swapper/621:45:116
80925599160,1cyclictest0-21swapper/621:45:106
80925599160,16cyclictest0-21swapper/623:32:366
80925599160,15cyclictest0-21swapper/622:50:116
80925599160,14cyclictest0-21swapper/623:45:586
80925599160,0cyclictest0-21swapper/622:47:346
80925599160,0cyclictest0-21swapper/621:07:466
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional