You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-26 - 05:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot7s.osadl.org (updated Fri Dec 26, 2025 00:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2092229380,9sleep20-21swapper/219:05:592
2105728979,6sleep00-21swapper/019:07:410
2098528066,10sleep30-21swapper/319:06:483
2117127958,17sleep10-21swapper/119:09:111
21324992323,0cyclictest0-21swapper/220:35:162
21321992119,1cyclictest26616-21wget23:50:181
2131899190,1cyclictest0-21swapper/020:20:130
2132899181,1cyclictest0-21swapper/321:00:143
2132899165,9cyclictest0-21swapper/322:10:133
2132899163,9cyclictest27661-21apt-get22:45:153
2132199162,3cyclictest0-21swapper/121:35:131
21328991511,3cyclictest3367-21wc23:00:203
2132499150,3cyclictest0-21swapper/200:05:182
2131899155,4cyclictest21269-21awk21:25:000
2131899151,7cyclictest18863-21munin-run23:35:000
2132899143,6cyclictest225-21systemd-journal21:54:553
21328991410,3cyclictest23857-21cat23:45:003
21324991413,1cyclictest0-21swapper/219:45:252
21324991413,1cyclictest0-21swapper/219:15:142
2132199149,3cyclictest3186-21cut20:45:211
2132199140,13cyclictest1913-21tail21:50:181
2132199140,12cyclictest29019-21grep19:25:151
2131899147,6cyclictest15554-21idleruntime-cro20:05:000
21318991412,1cyclictest22657-21cron20:20:000
21318991412,1cyclictest22657-21cron20:20:000
2131899140,8cyclictest6882-21perf23:09:590
2132899139,3cyclictest18842-21cron23:35:003
2132899139,2cyclictest638-21cut22:55:193
2132899131,6cyclictest0-21swapper/323:10:153
21328991310,2cyclictest5904-21grep00:10:293
21328991310,2cyclictest5904-21grep00:10:283
21328991310,2cyclictest3615-21wc19:40:003
21328991310,2cyclictest12704-21head21:05:183
2132899130,12cyclictest30681-21grep23:55:263
2132899130,12cyclictest13096-21tr23:20:223
2132499139,3cyclictest6966-21grep20:55:002
2132499131,1cyclictest0-21swapper/219:50:122
21324991310,2cyclictest8674-21cat20:55:292
21324991310,2cyclictest32532-21cut20:40:152
21324991310,2cyclictest3179-21cut20:45:212
21324991310,2cyclictest1974-21sed21:50:172
21324991310,2cyclictest14095-21sh21:09:592
2132199139,3cyclictest32165-21cron20:40:001
2132199139,2cyclictest8966-21cat00:20:001
21321991310,2cyclictest32718-21ls19:30:211
21321991310,2cyclictest31339-21cat00:00:001
21321991310,2cyclictest29633-21cut21:40:171
21321991310,2cyclictest28915-21sed20:30:241
21321991310,2cyclictest26811-21grep19:20:141
21321991310,2cyclictest25758-21grep23:45:291
21321991310,2cyclictest22652-21grep19:10:191
21321991310,2cyclictest2259-21wc23:00:001
21321991310,2cyclictest12203-21tr23:20:151
21321991310,2cyclictest10665-21grep00:20:271
21321991310,2cyclictest10528-21cat23:15:201
2132199130,12cyclictest0-21swapper/100:35:231
2131899139,3cyclictest31954-21grep21:45:180
2131899139,3cyclictest17966-21sed21:15:250
2131899139,3cyclictest14595-21tr23:25:160
2131899139,3cyclictest10004-21grep22:05:290
21318991310,2cyclictest9313-21tail19:50:160
21318991310,2cyclictest30573-21grep21:40:260
21318991310,2cyclictest26985-21tail20:25:260
21318991310,2cyclictest15111-21wc00:30:230
21318991310,2cyclictest13673-21grep21:05:260
2131899130,8cyclictest32156-21basename22:54:590
2132899129,2cyclictest9744-21grep23:15:153
2132899129,2cyclictest8612-21grep22:05:163
2132899129,2cyclictest6890-21cron20:55:003
2132899129,2cyclictest5456-21sed19:40:273
2132899129,2cyclictest3800-21grep00:10:003
2132899129,2cyclictest30632-21sort22:50:183
2132899129,2cyclictest26733-21tr21:35:153
2132899129,2cyclictest22229-21sort19:10:163
2132899129,2cyclictest16520-21head22:20:183
2132899129,2cyclictest13644-21tr20:00:143
2132899129,2cyclictest10367-21fgrep00:20:233
2132899128,3cyclictest31333-21wc20:35:253
2132899128,2cyclictest15964-21grep00:35:003
2132499129,2cyclictest774-21sed19:30:262
2132499129,2cyclictest7374-21grep23:10:182
2132499129,2cyclictest4998-21grep00:10:202
2132499129,2cyclictest4998-21grep00:10:192
2132499129,2cyclictest32279-21cat22:55:002
2132499129,2cyclictest31196-21awk00:00:002
2132499129,2cyclictest2941-21cat19:35:292
2132499129,2cyclictest28390-21tune2fs20:30:182
2132499129,2cyclictest27538-21cat21:35:202
2132499129,2cyclictest21239-21cron21:25:002
2132499129,2cyclictest17211-21cat20:05:262
2132499129,2cyclictest12630-21grep23:20:172
2132499129,2cyclictest12450-21wc00:25:212
2132499129,2cyclictest11164-21dump-pmu-power00:25:002
2132499129,2cyclictest11008-21tr22:10:152
2132199129,2cyclictest673-21sed00:00:261
2132199129,2cyclictest5488-21grep23:05:171
2132199129,2cyclictest5066-21grep20:50:151
2132199129,2cyclictest32382-21tr21:45:211
2132199129,2cyclictest29347-21grep22:45:281
2132199129,2cyclictest25989-21head22:40:151
2132199129,2cyclictest25580-21sed19:15:281
2132199129,2cyclictest22839-21fgrep23:40:221
2132199129,2cyclictest21197-21cut20:15:201
2132199129,2cyclictest21197-21cut20:15:191
2132199129,2cyclictest17908-21latency_hist20:10:011
2132199129,2cyclictest13685-21grep21:05:261
2132199129,2cyclictest13376-21tr22:15:171
2132199129,2cyclictest12142-21grep00:25:191
2132199125,2cyclictest225-21systemd-journal20:25:001
2132199123,5cyclictest225-21systemd-journal21:15:001
2132199120,11cyclictest26054-21head20:25:171
2131899129,2cyclictest8840-21grep23:10:310
2131899129,2cyclictest6719-21grep00:15:160
2131899129,2cyclictest29370-21tail20:30:290
2131899129,2cyclictest28252-21grep19:20:260
2131899129,2cyclictest27107-21sort23:50:190
2131899129,2cyclictest22625-21grep23:40:200
2131899129,2cyclictest1525-21cut00:05:190
2131899129,2cyclictest11196-21head23:15:260
2131899129,1cyclictest3678-21wc20:45:270
2131899128,3cyclictest28377-21tail22:45:190
2131899121,6cyclictest9283-21munin-run21:00:000
2132899119,1cyclictest3160-21grep20:45:213
2132899118,2cyclictest8314-21tail00:15:273
2132899118,2cyclictest8071-21cron22:05:013
2132899118,2cyclictest4788-21tr23:05:143
2132899118,2cyclictest32690-21grep20:40:163
2132899118,2cyclictest29990-21cut21:40:203
2132899118,2cyclictest28943-21cut19:25:153
2132899118,2cyclictest28846-21chrt20:30:223
2132899118,2cyclictest26047-21tail20:25:183
2132899118,2cyclictest25929-21chrt19:18:423
2132899118,2cyclictest24846-21expr23:45:173
2132899118,2cyclictest23097-21egrep20:20:143
2132899118,2cyclictest22795-21cat22:35:003
2132899118,2cyclictest16463-21cut20:05:173
2132899118,2cyclictest15500-21ls22:20:013
2132899118,2cyclictest14441-21grep21:10:163
2132899118,2cyclictest1080-21taskset19:33:513
2132899118,2cyclictest10249-21grep19:50:263
2132899118,1cyclictest11689-21grep19:55:153
2132899117,3cyclictest23163-21grep21:25:293
2132899115,3cyclictest455-21dbus-daemon22:40:003
2132899111,2cyclictest475-21in:imuxsock21:25:003
2132499119,1cyclictest29543-21grep21:40:162
2132499119,1cyclictest27422-21cron20:30:002
2132499119,1cyclictest13859-21grep22:15:192
2132499118,2cyclictest688-21head22:55:202
2132499118,2cyclictest32056-21grep00:00:162
2132499118,2cyclictest31483-21grep21:45:162
2132499118,2cyclictest25562-21tr22:40:142
2132499118,2cyclictest23617-21cron23:45:002
2132499118,2cyclictest22042-21df19:10:142
2132499118,2cyclictest15838-21aten2_r7power_p22:20:152
2132499118,2cyclictest15725-21smart_sda23:25:262
2132499118,2cyclictest15398-21sed00:30:272
2132499116,5cyclictest32-21ksoftirqd/220:15:162
2132499116,5cyclictest32-21ksoftirqd/220:15:152
2132499115,2cyclictest225-21systemd-journal21:14:592
2132499110,10cyclictest13162-21basename20:00:002
2132199119,1cyclictest32732-21grep20:40:151
2132199119,1cyclictest19834-21grep22:25:271
2132199118,2cyclictest8560-21python20:55:281
2132199118,2cyclictest6666-21expr19:45:141
2132199118,2cyclictest3598-21aten2_r7power_c21:55:141
2132199118,2cyclictest24150-21wc22:35:221
2132199118,2cyclictest22833-21cut22:35:011
2132199118,2cyclictest18426-21tr20:10:161
2132199118,2cyclictest17397-21sort23:30:191
2132199118,2cyclictest16209-21cat22:20:161
2132199118,2cyclictest13017-21chrt19:58:401
2132199118,2cyclictest11182-21grep21:00:271
2132199118,2cyclictest10172-21cat19:50:241
2132199117,3cyclictest24334-21cut21:30:151
2132199117,2cyclictest22259-21head21:25:201
2132199116,4cyclictest25-21ksoftirqd/123:27:201
2132199115,2cyclictest452-21systemd-logind00:06:051
2131899119,1cyclictest13257-21cut22:15:150
2131899118,2cyclictest9832-21cut00:20:180
2131899118,2cyclictest976-21cat22:55:210
2131899118,2cyclictest7207-21wc19:45:180
2131899118,2cyclictest32194-21grep00:00:160
2131899118,2cyclictest30174-21grep20:35:160
2131899118,2cyclictest28415-21taskset21:37:550
2131899118,2cyclictest25217-21uname23:45:200
2131899118,2cyclictest18292-21sleep00:40:000
2131899118,2cyclictest1729-21grep19:35:170
2131899118,2cyclictest16396-21sort20:05:160
2131899118,2cyclictest14805-21cat21:10:180
2131899118,2cyclictest12448-21cat00:25:200
2131899118,2cyclictest1125-21tail20:40:200
2131899117,3cyclictest5432-21grep20:50:170
2131899117,3cyclictest16864-21grep22:20:210
2131899117,3cyclictest10225-21cut21:00:180
2131899117,2cyclictest2620-21tr23:00:150
2131899117,2cyclictest11695-21grep19:55:160
2131899116,3cyclictest21477-21wc22:30:200
2131899115,4cyclictest25021-21idleruntime-cro22:40:000
2131899110,10cyclictest0-21swapper/022:10:140
2132899108,1cyclictest614-21sed00:00:253
2132899108,1cyclictest27102-21taskset22:41:283
2132899108,1cyclictest226352sleep320:19:493
2132899108,1cyclictest226352sleep320:19:483
2132899108,1cyclictest19886-21taskset22:25:353
2132899108,1cyclictest18733-21sed20:10:173
2132899108,1cyclictest18069-21taskset00:37:363
2132899107,2cyclictest7835-21sed19:45:253
2132899107,2cyclictest5648-21taskset21:59:423
2132899107,2cyclictest31859-21grep21:45:173
2132899107,2cyclictest26968-21sed23:50:183
2132899107,2cyclictest24077-21taskset21:30:113
2132899107,2cyclictest19878-21cut23:35:183
2132899107,2cyclictest13164-21chrt00:25:303
2132899106,3cyclictest7931-21grep20:55:193
2132899102,4cyclictest225-21systemd-journal23:27:213
2132499108,2cyclictest8634-21chrt00:18:322
2132499108,2cyclictest25255-21ntp_offset23:45:212
2132499108,1cyclictest5153-21expr23:05:152
2132499108,1cyclictest3311-21uname23:00:202
2132499108,1cyclictest30434-21cat19:25:262
2132499108,1cyclictest26201-21taskset21:34:562
2132499108,1cyclictest24904-21chrt22:38:592
2132499108,1cyclictest20978-21expr22:30:162
2132499108,1cyclictest199282sleep220:10:382
2132499108,1cyclictest18141-21aten2_r7power_c22:25:142
2132499108,1cyclictest17131-21expr21:15:182
2132499108,1cyclictest167062sleep223:30:082
2132499108,1cyclictest16130-21taskset00:35:122
2132499108,1cyclictest11467-21sshd23:18:192
2132499108,1cyclictest101272sleep222:05:572
2132499107,2cyclictest27314-21head19:20:162
2132499107,2cyclictest22305-21head21:25:202
2132499107,2cyclictest19120-21dpkg23:35:142
2132499107,2cyclictest15169-21taskset20:00:312
2132499101,2cyclictest0-21swapper/223:50:172
2132199108,1cyclictest9122-21seq23:13:441
2132199108,1cyclictest5374-21cat19:40:271
2132199108,1cyclictest21394-21date23:40:001
2132199108,1cyclictest20720-21cat21:20:261
2132199108,1cyclictest10691-21cat22:10:121
2132199107,2cyclictest6522-21sed22:00:171
2132199107,2cyclictest4349-21tr00:10:161
2132199107,2cyclictest4349-21tr00:10:161
2132199107,2cyclictest30368-21expr22:50:171
2132199107,2cyclictest15185-21taskset20:00:441
2132199106,3cyclictest3155-21cut23:00:181
2132199104,4cyclictest3446-21apache200:30:131
2131899108,1cyclictest3808-21expr21:55:150
2131899108,1cyclictest32105-21grep19:30:160
2131899108,1cyclictest29000-21sed23:55:010
2131899108,1cyclictest24075-21chrt21:30:090
2131899108,1cyclictest22461-21grep21:25:230
2131899107,2cyclictest5937-21tail00:10:280
2131899107,2cyclictest5937-21tail00:10:280
2131899107,2cyclictest4049-21sort19:40:160
2131899107,2cyclictest29652-21grep19:25:170
2131899107,2cyclictest26997-21grep22:40:240
2131899107,2cyclictest20160-21chrt22:29:070
2131899106,2cyclictest118932sleep023:20:120
2131899100,9cyclictest23934-21apache_volume19:15:150
2131899100,9cyclictest19917-21sed23:35:180
213289997,1cyclictest265042sleep319:20:063
213289991,4cyclictest225-21systemd-journal21:15:003
213249998,1cyclictest27882-21cut22:45:162
213249997,1cyclictest9827-21grep21:00:162
213249997,1cyclictest6123-21egrep22:00:162
213249997,1cyclictest3891-21seq21:55:152
213249997,1cyclictest23546-21fschecks_count20:20:162
213249991,7cyclictest3855-21apt-get19:40:152
213219998,1cyclictest17878-21ntpq21:15:241
213219997,1cyclictest8426-21basename22:05:151
213219997,1cyclictest2394-21uname19:35:221
213189997,1cyclictest6835-21if_enp2s022:00:190
213189997,1cyclictest233062sleep019:10:330
213189997,1cyclictest18251-21basename20:10:150
213189997,1cyclictest1728-21sed21:50:170
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional