You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-20 - 07:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack2slot7s.osadl.org (updated Sat Jun 20, 2026 00:43:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
420530999177,5cyclictest0-21swapper/200:15:472
420529998878,6cyclictest572051-21latency00:15:261
420528997950,26cyclictest571656-40mandb00:16:120
420528996543,16cyclictest12650irq/32-eth023:50:270
420528996047,9cyclictest0-21swapper/000:20:260
420528995438,14cyclictest561903-21ssh00:00:010
420530995042,5cyclictest577355-21munin-plugin-st00:25:012
420530994942,3cyclictest0-21swapper/221:40:312
420529994938,7cyclictest559129-21/usr/sbin/munin23:55:181
420528994842,3cyclictest586613-21ssh00:40:010
42053099445,30cyclictest519738-21ssh22:50:332
420529994435,6cyclictest575846-21unixbench_multi00:20:411
420528994435,6cyclictest421-21dbus-daemon23:20:020
420530994335,5cyclictest472216-21latency_hist21:35:022
420529994335,5cyclictest524798-21systemd-run23:00:021
420529994333,6cyclictest518597-21ssh22:50:021
420528994337,4cyclictest464280-21timerwakeupswit21:20:390
420530994234,5cyclictest422015-21grep19:15:012
420530994232,6cyclictest1-21systemd22:00:012
420530994231,8cyclictest549544-21idleruntime-cro23:40:012
42052999424,30cyclictest504102-21ssh22:25:281
420528994236,4cyclictest531002-21ssh23:10:020
42052899423,29cyclictest665-21snmpd22:30:330
42052899422,33cyclictest457525-21ssh21:10:270
420529994133,5cyclictest462773-21idleruntime-cro21:20:011
420529994132,6cyclictest1-21systemd22:25:011
420529994131,6cyclictest439-21systemd-logind23:50:021
420529994131,6cyclictest1-21systemd19:25:021
420529994129,9cyclictest1000-21mta-sts-daemon22:20:021
420528994133,4cyclictest0-21swapper/023:45:320
42052999403,29cyclictest485672-21ssh21:55:321
420529994032,5cyclictest515516-21latency_hist22:45:021
420529994028,9cyclictest541668-21switchtime23:25:421
420530993930,6cyclictest544919-21unixbench_multi23:30:402
420530993930,4cyclictest0-21swapper/221:20:302
420530993928,7cyclictest561985-21cups-browsed00:08:092
420529993931,5cyclictest546460-21systemd-run23:35:021
420529993930,5cyclictest534073-21munin-plugin-st23:15:011
420529993927,8cyclictest421-21dbus-daemon00:02:491
42052999392,32cyclictest556704-21ssh23:50:261
42052899393,28cyclictest473185-21ssh21:35:280
42053099383,29cyclictest488836-21ssh22:00:342
420530993829,5cyclictest0-21swapper/222:20:312
420530993827,7cyclictest421-21dbus-daemon00:10:322
420529993830,5cyclictest492363-21head22:05:471
420529993830,5cyclictest482031-21sort21:50:201
420529993829,6cyclictest423550-21systemd-run19:20:011
420529993827,8cyclictest476677-21threads21:40:421
42052899383,28cyclictest547451-21ssh23:35:280
420528993832,4cyclictest546440-21idleruntime-cro23:35:010
420528993828,8cyclictest543352-21munin-plugin-st23:30:010
420528993828,5cyclictest0-21swapper/023:20:360
420530993729,5cyclictest485-21in:imuxsock21:00:012
42052999373,24cyclictest466904-21ssh21:25:261
420529993729,5cyclictest475277-21tr21:40:011
420529993728,6cyclictest506819-21sh22:30:201
42052899374,28cyclictest522660-21ssh22:55:280
42052899374,27cyclictest665-21snmpd22:10:290
420528993731,4cyclictest491970-21wc22:05:400
420528993731,4cyclictest478405-21latency_hist21:45:020
420528993722,11cyclictest437051-21kworker/u8:18+events_unbound21:00:310
420528993713,14cyclictest151ktimers/020:10:310
420530993629,3cyclictest0-21swapper/223:50:012
420530993628,4cyclictest0-21swapper/221:50:282
420530993627,6cyclictest516531-21ntp_kernel_pll_22:45:292
420529993628,5cyclictest456545-21systemd-run21:10:011
420529993627,6cyclictest0-21swapper/122:40:011
420528993628,5cyclictest0-21swapper/021:15:350
420530993528,3cyclictest0-21swapper/223:20:372
420530993528,3cyclictest0-21swapper/221:10:272
420530993527,4cyclictest0-21swapper/222:40:012
420530993526,6cyclictest455017-21cron21:05:012
420530993526,5cyclictest1000-21mta-sts-daemon23:55:002
420529993527,5cyclictest582018-21unixbench_multi00:30:391
420529993527,5cyclictest569072-21ssh00:10:261
420529993526,5cyclictest1000-21mta-sts-daemon22:00:301
420529993524,8cyclictest433349-21ntp_kernel_err19:50:251
420529993524,8cyclictest433349-21ntp_kernel_err19:50:251
420529993524,6cyclictest2878171-21cups-browsed21:21:051
42052999352,25cyclictest519581-21ssh22:50:271
420529993519,2cyclictest0-21swapper/123:35:261
420529993511,7cyclictest459572-21sh21:14:491
420528993527,5cyclictest439-21systemd-logind20:10:020
420530993428,3cyclictest0-21swapper/222:15:012
420530993426,4cyclictest0-21swapper/221:45:322
420530993424,6cyclictest265-21systemd-journal20:55:012
42052999347,10cyclictest584027-21cpu00:35:191
420529993426,5cyclictest446036-21systemd-run20:35:011
420529993426,5cyclictest265-21systemd-journal20:40:011
420529993426,5cyclictest0-21swapper/119:40:011
420528993428,4cyclictest563549-21tail00:00:410
420528993428,4cyclictest534060-21cron23:15:010
420528993427,4cyclictest1002-21mta-sts-daemon22:25:330
420528993426,6cyclictest487710-21latency_hist22:00:020
420528993423,8cyclictest12650irq/32-eth021:45:320
42052899342,27cyclictest516493-21ssh22:45:280
420528993421,8cyclictest151ktimers/020:30:270
420530993327,3cyclictest0-21swapper/222:30:012
420530993325,5cyclictest423556-21systemd-run19:20:022
420530993324,6cyclictest421-21dbus-daemon20:45:012
420530993324,5cyclictest561992-21latency_hist00:00:032
42053099332,21cyclictest497858-21ssh22:15:262
42053099331,29cyclictest541397-21ssh23:25:342
420529993324,5cyclictest1-21systemd20:05:011
420529993320,8cyclictest479502-21ntpq21:45:331
420528993327,4cyclictest1002-21mta-sts-daemon21:27:280
420528993323,5cyclictest0-21swapper/019:55:290
420528993323,5cyclictest0-21swapper/019:55:290
42052899331,25cyclictest566070-21ssh00:05:300
420530993224,3cyclictest0-21swapper/223:10:272
420530993222,4cyclictest0-21swapper/222:55:312
42052999325,16cyclictest428-21mta-sts-daemon23:40:331
420529993224,5cyclictest443041-21idleruntime-cro20:25:011
420529993222,7cyclictest449362-21aten_r2power_po20:45:191
420529993220,8cyclictest452905-21ntpq20:55:311
42052899325,16cyclictest428-21mta-sts-daemon20:35:280
42052899323,24cyclictest550696-21ssh23:40:340
42052899323,24cyclictest2878171-21cups-browsed20:20:310
42052899323,19cyclictest151ktimers/019:20:400
420528993220,10cyclictest453382-21unixbench_multi20:55:420
420528993219,11cyclictest0-21swapper/021:30:370
42052899321,27cyclictest569287-21ssh00:10:350
42052899321,25cyclictest501051-21ssh22:20:290
420530993126,2cyclictest0-21swapper/200:05:012
420530993124,3cyclictest0-21swapper/221:15:182
420529993123,5cyclictest441565-21latency_hist20:20:021
420529993123,5cyclictest428015-21munin-plugin-st19:35:011
420529993123,5cyclictest421-21dbus-daemon00:10:021
420529993122,5cyclictest527887-21grep23:05:011
42052999312,21cyclictest528866-21ssh23:05:261
420529993117,8cyclictest425894-21ntpq19:25:281
42052999311,25cyclictest470018-21ssh21:30:261
420528993126,3cyclictest421-21dbus-daemon19:50:010
420528993125,4cyclictest426628-21latency_hist19:30:020
420530993024,3cyclictest0-21swapper/222:35:022
420530993023,3cyclictest0-21swapper/220:20:032
420530993022,5cyclictest537181-21idleruntime-cro23:20:012
420530993022,4cyclictest0-21swapper/223:00:202
420530993021,7cyclictest454991-21kworker/u8:0+events_unbound22:40:302
420530993021,6cyclictest421-21dbus-daemon20:45:392
420530993020,6cyclictest420-21avahi-daemon22:07:072
420530993020,5cyclictest0-21swapper/223:05:302
420529993022,3cyclictest535210-21ntpq23:15:341
420529993020,7cyclictest454371-21ntpq21:00:291
420529993019,7cyclictest430483-21ntpq19:40:351
420529993018,8cyclictest494861-21ntpq22:10:311
420529993018,8cyclictest443941-21ntpq20:25:301
420529993017,8cyclictest434879-21ntpq19:55:271
420529993017,8cyclictest434879-21ntpq19:55:271
420529993015,11cyclictest448397-21ntpq20:40:281
420528993024,3cyclictest0-21swapper/022:40:320
420530992922,4cyclictest570196-21kworker/u8:6-xprtiod00:35:192
42053099292,20cyclictest550613-21ssh23:40:302
420530992920,7cyclictest430853-21unixbench-2d19:40:442
42053099291,7cyclictest171rcu_preempt21:35:302
420529992920,4cyclictest431906-21ntpq19:45:281
420529992919,6cyclictest538215-21sh23:20:311
420529992919,6cyclictest421372-21ntpq19:10:261
420529992917,8cyclictest437903-21ntpq20:05:321
42052899299,15cyclictest151ktimers/019:10:290
42052899294,18cyclictest428-21mta-sts-daemon20:00:330
420528992923,3cyclictest0-21swapper/022:35:260
420528992922,4cyclictest456521-21diskmemload22:50:160
420528992921,6cyclictest0-21swapper/022:15:380
420528992920,4cyclictest430047-21fschecks_time19:40:220
42053099287,14cyclictest428-21mta-sts-daemon20:30:302
420530992822,3cyclictest0-21swapper/219:30:012
42053099282,19cyclictest578426-21ssh00:25:322
420530992821,4cyclictest443569-21gltestperf20:25:222
420530992820,5cyclictest583536-21munin-plugin-st00:35:012
420530992820,5cyclictest456545-21systemd-run21:10:012
420530992820,5cyclictest436893-21tail20:00:392
420530992820,5cyclictest434553-21grep19:55:222
420530992820,5cyclictest434553-21grep19:55:222
420529992818,7cyclictest577666-21/usr/sbin/munin00:25:221
420529992817,7cyclictest439412-21ntpq20:10:291
420529992813,12cyclictest451363-21ntpq20:50:281
420528992822,2cyclictest0-21swapper/022:00:180
42052899282,21cyclictest581488-21ssh00:30:290
420528992821,3cyclictest0-21swapper/023:00:330
42053099272,20cyclictest424519-21sshd19:20:412
420530992720,4cyclictest428655-21kernelversion19:35:232
420530992720,3cyclictest0-21swapper/221:25:292
420530992717,5cyclictest0-21swapper/219:50:252
420530992717,5cyclictest0-21swapper/219:50:252
420528992722,3cyclictest449039-21sh20:45:010
420528992720,4cyclictest450519-21idleruntime-cro20:50:010
420528992711,10cyclictest151ktimers/019:30:370
420530992620,3cyclictest0-21swapper/220:15:012
420530992619,5cyclictest0-21swapper/220:40:022
420530992619,4cyclictest0-21swapper/219:45:302
420528992621,3cyclictest1003-21mta-sts-daemon00:25:300
42052899261,20cyclictest482464-21/usr/sbin/munin21:50:280
420530992520,2cyclictest0-21swapper/220:20:312
420530992517,5cyclictest438462-21sed20:05:432
420528992518,4cyclictest423436-21unixbench_singl19:15:390
420528992516,6cyclictest456513-21cron21:10:000
420530992418,3cyclictest0-21swapper/219:10:022
420528992420,2cyclictest0-21swapper/020:55:010
420528992420,2cyclictest0-21swapper/019:10:010
420530992315,5cyclictest427536-21proc_pri19:30:392
42052899222,5cyclictest428986-21ntpq19:35:330
420528992212,7cyclictest0-21swapper/020:15:440
420528992116,2cyclictest0-21swapper/020:25:280
42052999209,8cyclictest420540-21unin-run19:10:021
420528992012,5cyclictest2878171-21cups-browsed19:52:480
420528992012,5cyclictest2878171-21cups-browsed19:52:480
42053199184,8cyclictest0-21swapper/300:15:213
42053199172,8cyclictest0-21swapper/322:50:333
42053199172,7cyclictest0-21swapper/300:10:303
42053199171,8cyclictest0-21swapper/321:40:333
42053199165,7cyclictest0-21swapper/300:30:273
42053199162,8cyclictest0-21swapper/323:25:433
42053199162,8cyclictest0-21swapper/322:20:303
42053199161,8cyclictest0-21swapper/323:50:263
42053199161,7cyclictest0-21swapper/319:30:323
42053199154,5cyclictest0-21swapper/322:10:313
42053199153,6cyclictest0-21swapper/321:50:393
42053199152,7cyclictest0-21swapper/322:25:273
42053199152,6cyclictest0-21swapper/323:35:273
42053199152,6cyclictest0-21swapper/323:20:183
42053199151,8cyclictest0-21swapper/323:45:333
42053199151,8cyclictest0-21swapper/300:20:303
42053199151,7cyclictest0-21swapper/319:40:283
42053199151,6cyclictest0-21swapper/320:35:273
42053199151,6cyclictest0-21swapper/320:15:323
42053199142,8cyclictest0-21swapper/322:55:363
42053199142,8cyclictest0-21swapper/322:35:323
42053199142,7cyclictest0-21swapper/322:40:283
42053199142,7cyclictest0-21swapper/321:25:263
42053199142,6cyclictest0-21swapper/323:10:253
42053199142,5cyclictest0-21swapper/320:55:313
42053199141,7cyclictest0-21swapper/323:40:313
42053199141,7cyclictest0-21swapper/321:30:323
42053199141,7cyclictest0-21swapper/321:10:283
42053199141,6cyclictest0-21swapper/320:45:283
42053199141,6cyclictest0-21swapper/320:10:263
42053199141,6cyclictest0-21swapper/320:05:263
42053199141,6cyclictest0-21swapper/319:20:273
42053199141,6cyclictest0-21swapper/319:15:273
42053199141,6cyclictest0-21swapper/300:00:273
42053199141,5cyclictest0-21swapper/319:45:263
42053199134,6cyclictest0-21swapper/322:00:263
42053199133,4cyclictest0-21swapper/320:40:333
42053199132,7cyclictest0-21swapper/300:00:023
42053199132,6cyclictest0-21swapper/321:20:263
42053199132,6cyclictest0-21swapper/300:05:323
42053199131,8cyclictest0-21swapper/300:35:283
42053199131,7cyclictest0-21swapper/323:30:303
42053199131,7cyclictest0-21swapper/323:15:283
42053199131,7cyclictest0-21swapper/323:05:263
42053199131,7cyclictest0-21swapper/322:45:323
42053199131,7cyclictest0-21swapper/321:45:333
42053199131,7cyclictest0-21swapper/321:35:263
42053199131,6cyclictest0-21swapper/320:25:323
42053199131,6cyclictest0-21swapper/319:50:263
42053199131,6cyclictest0-21swapper/319:50:263
42053199131,5cyclictest0-21swapper/319:25:283
42053199123,6cyclictest0-21swapper/323:00:443
42053199122,5cyclictest0-21swapper/321:10:003
42053199122,5cyclictest0-21swapper/319:55:303
42053199122,5cyclictest0-21swapper/319:55:303
42053199121,7cyclictest0-21swapper/322:05:323
42053199121,7cyclictest0-21swapper/321:55:193
42053199121,7cyclictest0-21swapper/321:15:273
42053199121,7cyclictest0-21swapper/300:25:263
42053199121,6cyclictest0-21swapper/322:15:173
42053199121,6cyclictest0-21swapper/320:30:293
42053199121,6cyclictest0-21swapper/319:10:333
42053199111,6cyclictest0-21swapper/322:30:173
42053199111,5cyclictest0-21swapper/321:00:303
42053199110,6cyclictest0-21swapper/320:20:303
42053199101,5cyclictest0-21swapper/320:50:283
4205319992,5cyclictest0-21swapper/320:00:263
4205319991,6cyclictest0-21swapper/319:35:303
4205319981,4cyclictest0-21swapper/319:10:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional