You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-22 - 21:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Mon Jun 22, 2026 12:43:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
966950995140,9cyclictest1009105-21ssh09:20:010
966950995139,8cyclictest163119-21cups-browsed10:25:330
966952995041,6cyclictest420-21avahi-daemon10:25:332
966951995043,3cyclictest0-21swapper/111:00:251
966950994729,15cyclictest966972-21latency_hist07:10:010
966952994540,2cyclictest0-21swapper/210:30:302
966952994437,4cyclictest1000-21mta-sts-daemon09:53:552
966952994436,5cyclictest975968-21systemd-run07:40:022
966951994436,5cyclictest993966-21systemd-run08:40:011
966950994439,2cyclictest0-21swapper/011:45:420
966950994434,6cyclictest1002-21mta-sts-daemon12:35:300
966952994335,5cyclictest983468-21systemd-run08:05:012
966952994233,5cyclictest999908-21cron09:00:012
96695299423,33cyclictest1093138-21ssh11:35:342
966951994234,5cyclictest1095183-21idleruntime-cro11:40:001
966950994236,4cyclictest1042926-21ssh10:15:000
966950994236,4cyclictest1042926-21ssh10:15:000
966952994133,5cyclictest1131854-21idleruntime-cro12:40:002
966952994132,6cyclictest974447-21systemd-run07:35:012
966952994132,5cyclictest1049156-21ssh10:25:012
966952994131,7cyclictest439-21systemd-logind07:55:012
966951994135,4cyclictest0-21swapper/110:20:391
966950994135,4cyclictest421-21dbus-daemon11:30:010
966950994135,4cyclictest421-21dbus-daemon11:30:010
966952994030,7cyclictest163116-21cupsd12:02:592
966952993931,5cyclictest1099501-21awk11:45:372
966952993929,7cyclictest981936-21idleruntime-cro08:00:012
966952993929,7cyclictest1009105-21ssh09:20:012
966951993932,4cyclictest1112169-21unixbench_singl12:05:441
966950993932,3cyclictest0-21swapper/009:00:010
966952993828,8cyclictest1089381-21sh11:30:202
966952993828,8cyclictest1089381-21sh11:30:202
966952993828,6cyclictest163119-21cups-browsed12:18:012
966952993824,9cyclictest1116701-21sh12:15:022
96695199383,31cyclictest1114647-21ssh12:10:301
966951993831,3cyclictest0-21swapper/112:00:351
966951993830,5cyclictest1002933-21munin-plugin-st09:10:011
966950993831,5cyclictest1107428-21ssh12:00:010
966950993831,4cyclictest1095169-21munin-run11:40:010
966950993828,6cyclictest1024862-21aten_r2power_cu09:45:180
966950993822,10cyclictest151ktimers/008:15:270
96695299374,27cyclictest1056520-21rm10:35:372
96695299373,29cyclictest1083928-21ssh11:20:262
96695299373,29cyclictest1083928-21ssh11:20:262
966952993727,7cyclictest1079894-21systemd-run11:15:022
966952993726,8cyclictest1034206-21aten_r2power_po10:00:202
966950993732,2cyclictest0-21swapper/009:40:380
966952993628,5cyclictest992434-21munin-plugin-st08:35:002
966952993628,3cyclictest0-21swapper/210:48:192
966952993627,6cyclictest163119-21cups-browsed11:05:022
96695299362,26cyclictest1105353-21ssh11:55:282
96695199365,20cyclictest1000-21mta-sts-daemon07:10:341
966951993630,3cyclictest0-21swapper/109:55:011
966951993630,3cyclictest0-21swapper/107:20:011
966951993628,5cyclictest1003977-21ntp_kernel_pll_09:10:311
966951993627,6cyclictest1105997-21unixbench_singl11:55:421
96695199361,30cyclictest1099308-21ssh11:45:311
966950993631,4cyclictest966949-21cyclictest09:20:450
966950993622,10cyclictest0-21swapper/008:25:340
966950993622,10cyclictest0-21swapper/008:25:340
96695299354,28cyclictest1025582-21ssh09:45:312
96695299353,26cyclictest1065576-21ssh10:50:312
966952993527,5cyclictest984932-21cron08:10:012
966952993527,5cyclictest1098261-21munin-run11:45:012
966952993527,5cyclictest1082931-21munin-run11:20:012
966952993527,4cyclictest0-21swapper/208:15:022
966952993527,3cyclictest0-21swapper/209:20:222
966951993527,4cyclictest0-21swapper/110:55:311
96695199352,24cyclictest1031651-21ssh09:55:261
966950993525,7cyclictest1120278-21cpu12:20:240
966950993525,7cyclictest1120278-21cpu12:20:240
966950993523,5cyclictest1117685-21ssh12:15:300
966950993522,10cyclictest0-21swapper/012:05:390
966950993519,9cyclictest12650irq/32-eth009:55:320
96695299347,17cyclictest163119-21cups-browsed09:25:352
966952993428,3cyclictest0-21swapper/211:00:012
966952993426,6cyclictest0-21swapper/210:10:372
966952993426,6cyclictest0-21swapper/210:10:372
966952993426,5cyclictest1102842-21unixbench-2d11:50:412
966952993425,6cyclictest1-21systemd12:35:012
966952993425,6cyclictest1-21systemd12:35:012
966952993424,6cyclictest971464-21systemd-run07:25:012
966952993424,6cyclictest971464-21systemd-run07:25:012
96695299342,26cyclictest1003978-21ssh09:10:312
966951993427,4cyclictest1080835-21netstat11:15:271
966951993427,4cyclictest1052205-21ssh10:30:011
966951993426,5cyclictest1123458-21/usr/sbin/munin12:25:251
966951993426,5cyclictest1064492-21cron10:50:011
966951993426,5cyclictest1009269-21latency_hist09:20:031
966951993426,5cyclictest0-21swapper/107:40:011
966951993426,4cyclictest0-21swapper/108:15:301
966951993424,7cyclictest1126547-21kernelversion12:30:251
966951993424,7cyclictest1126547-21kernelversion12:30:251
966951993423,8cyclictest1120640-21missed_timers12:20:311
966951993423,8cyclictest1120640-21missed_timers12:20:311
966951993423,3cyclictest171rcu_preempt10:05:031
96695199342,25cyclictest1013222-21ssh09:25:291
966951993421,9cyclictest0-21swapper/109:35:361
966951993412,3cyclictest1025484-21sh09:45:271
966950993429,2cyclictest0-21swapper/011:20:010
966950993424,7cyclictest1005614-21kworker/u8:2-rpciod09:15:020
966950993421,10cyclictest1078348-21unixbench-2d11:10:400
96695299333,23cyclictest1111689-21ssh12:05:382
966952993327,3cyclictest0-21swapper/210:20:012
966952993325,5cyclictest995428-21cron08:45:012
966952993324,5cyclictest163119-21cups-browsed09:30:552
966951993325,5cyclictest1130443-21unixbench_singl12:35:401
966951993325,5cyclictest1055288-21munin-plugin-st10:35:011
966951993314,10cyclictest1002931-21diskmemload12:15:301
966950993327,4cyclictest1030696-21systemd-run09:55:010
966950993326,5cyclictest1001460-21systemd-run09:05:010
966950993326,4cyclictest983322-21unixbench_multi08:00:420
966950993326,4cyclictest151ktimers/009:25:360
966950993321,9cyclictest1090525-21timerandwakeup11:30:420
966950993321,9cyclictest1090525-21timerandwakeup11:30:420
966952993224,5cyclictest987924-21cron08:20:002
966951993227,2cyclictest0-21swapper/110:50:311
966951993225,4cyclictest973456-21fschecks_count07:30:231
966951993225,4cyclictest1000-21mta-sts-daemon10:15:281
966951993224,5cyclictest1024520-21cron09:45:011
96695199322,22cyclictest988882-21sshd08:20:301
96695099323,20cyclictest1002931-21diskmemload12:00:350
966950993226,4cyclictest1055274-21ssh10:35:010
966950993225,4cyclictest1036803-21cron10:05:010
966950993219,10cyclictest1037524-21if_eth010:05:240
966950993219,10cyclictest1037524-21if_eth010:05:240
96695099321,26cyclictest750-21ntpd08:10:310
966952993124,4cyclictest977005-21sendmail_mailqu07:40:342
966952993124,4cyclictest1023037-21unixbench_multi09:40:412
966952993124,3cyclictest0-21swapper/209:55:262
966952993123,4cyclictest0-21swapper/212:25:232
966952993122,4cyclictest1074747-21sh11:05:282
96695299312,24cyclictest1019361-21ssh09:35:302
966951993124,4cyclictest1000-21mta-sts-daemon11:34:451
966951993124,4cyclictest1000-21mta-sts-daemon11:34:451
966951993123,5cyclictest995428-21cron08:45:011
966951993118,5cyclictest1003-21mta-sts-daemon08:50:321
96695199311,22cyclictest1010197-21ssh09:20:351
96695099314,20cyclictest1102452-21ssh11:50:350
96695099313,22cyclictest1044048-21ssh10:15:330
966950993124,4cyclictest981916-21cron08:00:010
966950993123,6cyclictest1123796-21ntp_kernel_pll_12:25:330
966950993123,6cyclictest1075064-21sensors_volt11:05:390
966950993123,4cyclictest0-21swapper/012:10:350
966950993123,3cyclictest0-21swapper/012:30:300
966950993123,3cyclictest0-21swapper/012:30:300
966950993122,6cyclictest0-21swapper/010:55:020
966952993023,4cyclictest1121406-21grep12:20:512
966952993023,4cyclictest1121406-21grep12:20:512
966952993023,3cyclictest0-21swapper/208:25:342
966952993023,3cyclictest0-21swapper/208:25:342
966952993021,6cyclictest969940-21cut07:20:012
966952993019,3cyclictest988463-21fschecks_count08:20:212
966952993018,3cyclictest997451-21fschecks_time08:50:232
966951993024,3cyclictest0-21swapper/109:30:331
966951993023,4cyclictest1074353-21fschecks_count11:05:221
966951993022,5cyclictest1083702-21kernelversion11:20:231
966951993022,5cyclictest1083702-21kernelversion11:20:231
966951993022,5cyclictest1056235-21needreboot10:35:271
966951993021,7cyclictest1086943-21needreboot11:25:261
966951993021,7cyclictest1086943-21needreboot11:25:261
96695199301,22cyclictest1040999-21ssh10:10:341
96695199301,22cyclictest1040999-21ssh10:10:341
96695099308,14cyclictest428-21mta-sts-daemon09:35:290
966950993024,4cyclictest980429-21grep07:55:010
966950993024,3cyclictest1003-21mta-sts-daemon11:41:490
96695099302,22cyclictest750-21ntpd11:21:200
96695099302,22cyclictest750-21ntpd11:21:200
96695099302,22cyclictest1068629-21ssh10:55:310
966950993018,10cyclictest966949-21cyclictest11:01:130
966952992922,4cyclictest1002931-21diskmemload10:10:022
966952992922,4cyclictest1002931-21diskmemload10:10:022
96695299292,23cyclictest1059363-21ssh10:40:272
966952992917,8cyclictest972924-21kworker/u8:1+xprtiod07:50:012
966952992917,2cyclictest997017-21latency_hist08:50:022
96695199294,20cyclictest1059359-21ntpq10:40:271
966951992923,3cyclictest0-21swapper/111:15:011
966951992923,3cyclictest0-21swapper/108:00:421
966951992921,5cyclictest439-21systemd-logind08:00:011
966951992919,7cyclictest694-21cron08:30:011
966951992919,7cyclictest694-21cron08:30:011
96695199291,26cyclictest1102388-21ssh11:50:321
96695099292,22cyclictest163119-21cups-browsed08:30:280
966950992921,6cyclictest694-21cron07:45:010
966950992917,8cyclictest163119-21cups-browsed10:23:430
966950992912,11cyclictest151ktimers/007:30:310
966952992820,6cyclictest57-21kcompactd011:25:272
966952992820,6cyclictest57-21kcompactd011:25:272
966951992821,5cyclictest0-21swapper/107:45:021
966951992821,4cyclictest1001-21mta-sts-daemon09:00:351
966951992818,7cyclictest694-21cron07:55:011
966951992817,7cyclictest1037821-21ssh10:05:301
966951992817,7cyclictest1037821-21ssh10:05:301
966951992816,9cyclictest694-21cron07:50:011
96695199281,22cyclictest163119-21cups-browsed07:25:321
966950992822,3cyclictest0-21swapper/009:30:330
966952992720,3cyclictest0-21swapper/209:10:012
966951992720,4cyclictest996923-21cron08:50:011
966951992720,4cyclictest970477-21fschecks_time07:20:231
966951992720,4cyclictest970477-21fschecks_time07:20:231
966951992720,4cyclictest1002-21mta-sts-daemon08:15:021
966951992720,4cyclictest0-21swapper/111:40:371
966950992721,3cyclictest0-21swapper/008:40:010
966950992719,6cyclictest694-21cron08:55:010
966950992719,6cyclictest1062240-21latency10:45:240
966950992716,9cyclictest0-21swapper/010:35:400
966952992620,3cyclictest0-21swapper/208:40:002
966952992619,4cyclictest1002-21mta-sts-daemon07:27:002
96695199261,4cyclictest171rcu_preempt08:30:281
966950992616,7cyclictest12650irq/32-eth007:45:310
96695099261,20cyclictest1058966-21df_inode10:40:210
966952992517,5cyclictest1001295-21tail09:00:412
966951992517,3cyclictest0-21swapper/108:55:311
96695099252,13cyclictest12650irq/32-eth008:05:320
966950992520,2cyclictest0-21swapper/008:45:020
966950992519,4cyclictest971966-21fschecks_count07:25:260
966950992518,5cyclictest0-21swapper/007:15:400
966952992417,3cyclictest0-21swapper/207:10:012
966950992420,2cyclictest0-21swapper/007:15:010
966950992418,4cyclictest151ktimers/008:45:350
966952992317,3cyclictest0-21swapper/207:10:252
96695199224,14cyclictest984462-21ps08:05:391
966951992215,4cyclictest936626-21kworker/u8:10+xprtiod07:10:021
96695099220,7cyclictest974943-21fschecks_count07:35:210
96695399213,11cyclictest0-21swapper/310:25:333
96695399212,11cyclictest0-21swapper/311:10:273
96695399212,10cyclictest0-21swapper/311:40:323
96695099215,3cyclictest171rcu_preempt09:05:290
96695099212,14cyclictest970905-21ntpq07:20:330
96695099212,14cyclictest970905-21ntpq07:20:330
966950992114,5cyclictest0-21swapper/008:20:190
96695399202,9cyclictest0-21swapper/308:35:013
96695399202,11cyclictest0-21swapper/311:30:323
96695399202,11cyclictest0-21swapper/311:30:323
96695399202,11cyclictest0-21swapper/311:00:253
96695399202,10cyclictest0-21swapper/312:35:263
96695399193,9cyclictest0-21swapper/309:15:283
96695399193,10cyclictest0-21swapper/309:45:283
96695399193,10cyclictest0-21swapper/307:30:293
96695399192,9cyclictest0-21swapper/310:15:323
96695399192,7cyclictest0-21swapper/308:10:293
96695399192,11cyclictest0-21swapper/309:25:303
96695399192,10cyclictest0-21swapper/311:15:283
96695399191,12cyclictest0-21swapper/312:20:263
96695399191,12cyclictest0-21swapper/312:20:263
96695399183,9cyclictest0-21swapper/311:50:313
96695399182,9cyclictest0-21swapper/312:05:283
96695399182,8cyclictest0-21swapper/308:55:023
96695399182,8cyclictest0-21swapper/307:25:323
96695399182,7cyclictest0-21swapper/308:15:293
96695399182,10cyclictest0-21swapper/312:10:303
96695399182,10cyclictest0-21swapper/312:00:293
96695399182,10cyclictest0-21swapper/311:20:183
96695399182,10cyclictest0-21swapper/311:20:183
96695399181,9cyclictest0-21swapper/309:55:033
96695399181,8cyclictest0-21swapper/308:55:273
96695399174,7cyclictest0-21swapper/309:55:263
96695399173,8cyclictest0-21swapper/310:55:283
96695399173,8cyclictest0-21swapper/310:45:293
96695399173,8cyclictest0-21swapper/310:00:233
96695399172,9cyclictest0-21swapper/312:15:253
96695399172,9cyclictest0-21swapper/311:25:283
96695399172,9cyclictest0-21swapper/311:25:283
96695399172,9cyclictest0-21swapper/311:05:283
96695399172,9cyclictest0-21swapper/310:20:333
96695399172,9cyclictest0-21swapper/309:40:283
96695399172,8cyclictest0-21swapper/311:55:313
96695399172,8cyclictest0-21swapper/308:20:303
96695399172,10cyclictest0-21swapper/310:05:433
96695399172,10cyclictest0-21swapper/310:05:433
96695399171,9cyclictest0-21swapper/310:40:323
96695399171,9cyclictest0-21swapper/309:30:273
96695399171,10cyclictest0-21swapper/310:10:303
96695399171,10cyclictest0-21swapper/310:10:303
96695399171,10cyclictest0-21swapper/309:10:313
96695399167,5cyclictest431ktimers/307:10:013
96695399163,8cyclictest0-21swapper/312:30:283
96695399163,8cyclictest0-21swapper/312:30:283
96695399162,9cyclictest0-21swapper/311:35:313
96695399162,9cyclictest0-21swapper/310:50:303
96695399162,7cyclictest0-21swapper/312:25:183
96695399162,6cyclictest0-21swapper/307:40:263
96695399162,5cyclictest0-21swapper/308:00:283
96695399161,7cyclictest0-21swapper/309:05:323
96695399161,7cyclictest0-21swapper/307:20:283
96695399161,7cyclictest0-21swapper/307:20:283
96695399153,8cyclictest0-21swapper/310:30:303
96695399153,7cyclictest0-21swapper/311:45:183
96695399152,9cyclictest0-21swapper/310:35:323
96695399152,8cyclictest0-21swapper/309:20:343
96695399152,8cyclictest0-21swapper/308:45:243
96695399151,8cyclictest0-21swapper/309:35:213
96695399151,7cyclictest0-21swapper/308:35:293
96695399151,7cyclictest0-21swapper/308:25:343
96695399151,7cyclictest0-21swapper/308:25:343
96695399151,7cyclictest0-21swapper/308:05:323
96695399151,7cyclictest0-21swapper/307:10:303
96695399142,7cyclictest0-21swapper/308:40:313
96695399142,7cyclictest0-21swapper/307:35:293
96695399142,6cyclictest0-21swapper/307:15:293
96695399141,8cyclictest0-21swapper/307:50:023
96695399141,7cyclictest0-21swapper/307:55:343
96695399132,6cyclictest0-21swapper/309:00:303
96695399131,7cyclictest0-21swapper/307:50:283
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional