You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-20 - 09:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot5s.osadl.org (updated Mon Apr 20, 2026 00:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3983742995738,15cyclictest0-21swapper/100:20:001
3983750995315,34cyclictest629-21snmpd19:25:133
3983742994940,5cyclictest4005148-21ls20:10:011
3983747994739,5cyclictest4049680-21cron22:20:012
3983747994739,5cyclictest4049680-21cron22:20:012
3983738994739,5cyclictest438-21cron21:10:000
3983742994638,4cyclictest4027321-21munin-plugin-st21:15:011
3983750994416,3cyclictest0-21swapper/320:09:423
3983742994436,5cyclictest4022174-21cron21:00:001
3983742994436,5cyclictest4022174-21cron21:00:001
3983750994319,4cyclictest0-21swapper/323:25:263
3983750994319,4cyclictest0-21swapper/323:25:253
3983750994313,5cyclictest0-21swapper/321:45:163
3983742994330,8cyclictest0-21swapper/122:40:271
398374299431,6cyclictest4019647-21/usr/sbin/munin20:50:231
398374299431,10cyclictest4033361-21/usr/sbin/munin21:30:251
398374299422,36cyclictest3996801-21fschecks_count19:45:161
398374299422,36cyclictest3996801-21fschecks_count19:45:151
398374299421,7cyclictest4080721-21/usr/sbin/munin23:50:131
3983742994213,26cyclictest4085962-21/usr/sbin/munin00:05:181
3983747994130,8cyclictest3987871-21cron19:20:022
3983742994131,6cyclictest4038781-21unixbench_multi21:45:261
398374299410,9cyclictest4007209-21/usr/sbin/munin20:15:171
398374299403,5cyclictest4041304-21diskstats21:55:171
398374299402,4cyclictest4008913-21df_inode20:20:171
398374299401,9cyclictest4092108-21/usr/sbin/munin00:20:251
398374299401,7cyclictest3995385-21/usr/sbin/munin19:40:191
398374299401,5cyclictest4052481-21/usr/sbin/munin22:25:251
398374299401,5cyclictest4046263-21sshd22:09:531
3983750993932,4cyclictest3994710-21sendmail19:40:013
398374299394,5cyclictest4032033-21unixbench_singl21:25:271
398374299393,4cyclictest4055037-21apt-get22:35:121
398374299392,6cyclictest4076080-21ntp_states23:35:231
398374299392,5cyclictest4015616-21apt-get20:40:121
398374299391,9cyclictest4062982-21cron22:56:001
398374299391,8cyclictest4001971-21/usr/sbin/munin20:00:271
398374299391,7cyclictest4044490-21cron22:04:001
398374299391,6cyclictest4069753-21users23:15:261
398374299391,10cyclictest4005944-21ntp_states20:10:221
3983750993811,5cyclictest0-21swapper/322:25:263
398374299388,26cyclictest4088486-21sed00:10:241
398374299382,4cyclictest4071149-21/usr/sbin/munin23:20:241
398374299381,9cyclictest4067058-21/usr/sbin/munin23:10:141
398374299381,9cyclictest4029712-21meminfo21:20:201
398374299381,9cyclictest4022438-21apt-get21:00:131
398374299381,6cyclictest4034364-21apt-get21:35:131
398374299381,6cyclictest4017880-21ntp_states20:45:211
3983742993816,17cyclictest0-21swapper/121:15:161
398374299381,5cyclictest4024658-21/usr/sbin/munin21:05:221
398374299381,4cyclictest4065550-21/usr/sbin/munin23:05:171
398374299381,4cyclictest4036346-21/usr/sbin/munin21:40:171
398374299381,10cyclictest4039929-21meminfo21:50:191
3983742993810,24cyclictest0-21swapper/122:45:211
3983747993731,3cyclictest4070150-21kthreadd23:20:002
3983747993726,8cyclictest4051405-21auditctl22:25:002
3983747993726,7cyclictest0-21swapper/222:25:262
398374299379,25cyclictest0-21swapper/120:30:211
398374299373,4cyclictest4074250-21meminfo23:30:181
398374299373,3cyclictest4054713-21cron22:34:011
398374299371,9cyclictest4085130-21users00:00:271
398374299371,9cyclictest4050510-21ntp_states22:20:241
398374299371,9cyclictest3985217-21cron19:11:011
398374299371,4cyclictest4095558-21/usr/sbin/munin00:30:271
398374299371,3cyclictest4096306-21df_inode00:35:161
398374299371,3cyclictest3999638-21cron19:53:001
398374299371,12cyclictest4000370-21df_inode19:55:171
3983742993710,22cyclictest0-21swapper/123:27:041
3983742993710,22cyclictest0-21swapper/123:27:041
3983738993726,7cyclictest4088693-21grep00:10:260
3983738993726,7cyclictest4074800-21grep23:30:240
3983747993627,6cyclictest0-21swapper/220:40:002
3983747993626,6cyclictest0-21swapper/220:20:012
3983747993625,8cyclictest4034127-21sh21:35:002
398374299362,5cyclictest4049200-21grep22:15:251
398374299362,5cyclictest4049200-21grep22:15:251
398374299362,4cyclictest4063575-21/usr/sbin/munin23:00:141
398374299361,9cyclictest3989975-21grep19:25:181
398374299361,9cyclictest3989365-21chrt19:22:251
398374299361,7cyclictest3986531-21fschecks_count19:15:151
398374299361,6cyclictest4083369-21grep23:55:251
398374299361,5cyclictest629-21snmpd20:25:491
3983738993619,14cyclictest11-21ksoftirqd/023:25:120
3983738993619,14cyclictest11-21ksoftirqd/023:25:120
3983747993528,4cyclictest4095969-21munin-plugin-st00:35:002
3983747993526,6cyclictest0-21swapper/200:25:012
3983742993527,5cyclictest4080402-21munin-plugin-st23:50:001
398374299352,6cyclictest3991625-21df19:30:151
398374299351,9cyclictest4014235-21irqstats20:35:191
398374299351,6cyclictest4061051-21sed22:50:251
398374299351,5cyclictest3993635-21sed19:35:171
398374299351,4cyclictest4092883-21cat00:25:161
3983738993529,4cyclictest0-21swapper/019:55:150
3983738993525,6cyclictest4008583-21idleruntime-cro20:20:010
3983738993525,6cyclictest3999381-21grep19:50:260
3983738993525,6cyclictest0-21swapper/021:00:000
3983738993525,6cyclictest0-21swapper/021:00:000
3983738993525,4cyclictest0-21swapper/021:16:390
3983750993427,3cyclictest0-21swapper/320:15:173
3983747993427,4cyclictest0-21swapper/220:35:012
3983747993426,4cyclictest0-21swapper/222:55:162
3983747993426,4cyclictest0-21swapper/220:10:162
3983747993425,6cyclictest3992513-21unixbench_multi19:30:272
3983747993425,4cyclictest0-21swapper/221:20:272
3983747993424,7cyclictest4026839-21grep21:10:262
3983747993424,7cyclictest0-21swapper/223:55:002
3983747993424,6cyclictest0-21swapper/223:30:252
3983747993424,6cyclictest0-21swapper/222:00:252
398374299342,7cyclictest4077776-21ntpq23:40:211
398374299341,4cyclictest4047108-21/usr/sbin/munin22:10:221
3983738993426,6cyclictest121ktimers/019:25:130
3983738993426,5cyclictest4015374-21idleruntime-cro20:40:000
3983747993324,6cyclictest0-21swapper/223:05:002
3983747993323,7cyclictest4035856-21idleruntime-cro21:40:002
3983747993322,7cyclictest0-21swapper/219:10:252
3983747993322,6cyclictest0-21swapper/200:15:252
3983738993322,7cyclictest0-21swapper/019:15:250
3983750993224,4cyclictest0-21swapper/300:05:003
3983747993222,6cyclictest0-21swapper/220:25:012
3983747993221,6cyclictest0-21swapper/221:30:002
3983738993225,4cyclictest4011970-21latency_hist20:30:000
3983738993224,5cyclictest4035838-21munin-plugin-st21:40:010
3983738993224,4cyclictest4042652-21sh22:00:000
3983738993223,6cyclictest121ktimers/022:10:110
3983738993222,6cyclictest0-21swapper/021:10:170
3983738993221,7cyclictest0-21swapper/019:15:010
3983750993124,4cyclictest0-21swapper/323:35:263
3983750993124,4cyclictest0-21swapper/321:25:263
3983747993124,4cyclictest0-21swapper/220:40:252
3983747993124,4cyclictest0-21swapper/219:25:262
3983747993124,3cyclictest0-21swapper/221:00:182
3983747993121,7cyclictest311ktimers/223:25:122
3983747993121,7cyclictest311ktimers/223:25:122
3983747993121,6cyclictest4042251-21grep21:55:272
3983747993121,6cyclictest0-21swapper/219:50:002
3983747993121,6cyclictest0-21swapper/219:50:002
3983738993121,7cyclictest4070579-21tune2fs23:20:170
3983750993023,4cyclictest0-21swapper/300:15:263
3983750993022,4cyclictest0-21swapper/322:40:273
3983750993022,4cyclictest0-21swapper/321:20:263
3983750993021,6cyclictest0-21swapper/322:35:153
3983747993024,3cyclictest0-21swapper/200:30:002
3983747993022,4cyclictest0-21swapper/223:50:002
3983747993021,6cyclictest0-21swapper/222:30:172
3983738993023,4cyclictest4097236-21head00:35:290
3983738993022,4cyclictest0-21swapper/023:15:000
3983738993019,7cyclictest0-21swapper/019:30:280
3983738993018,10cyclictest11-21ksoftirqd/022:45:120
3983738993014,12cyclictest121ktimers/023:15:100
398373899300,27cyclictest0-21swapper/000:20:120
3983750992922,4cyclictest0-21swapper/321:15:253
3983750992922,4cyclictest0-21swapper/320:15:013
3983750992921,3cyclictest0-21swapper/321:00:013
3983750992921,3cyclictest0-21swapper/321:00:003
3983750992918,8cyclictest3985759-21sh19:15:013
3983747992922,4cyclictest0-21swapper/220:51:352
3983747992921,6cyclictest4054423-21kworker/u8:0+events_unbound22:46:572
3983747992919,6cyclictest0-21swapper/200:35:282
3983747992918,7cyclictest0-21swapper/222:45:012
3983738992919,6cyclictest0-21swapper/022:30:000
3983750992821,4cyclictest0-21swapper/321:10:273
3983750992821,3cyclictest0-21swapper/323:22:043
3983750992819,6cyclictest0-21swapper/322:10:263
3983750992819,5cyclictest0-21swapper/323:45:263
3983747992822,3cyclictest0-21swapper/223:10:252
3983747992822,3cyclictest0-21swapper/220:25:262
3983747992821,5cyclictest4018598-21kworker/u8:3+events_unbound21:16:402
3983747992821,4cyclictest0-21swapper/222:50:252
3983747992820,4cyclictest0-21swapper/221:05:172
3983747992818,6cyclictest0-21swapper/223:55:262
398373899287,19cyclictest121ktimers/022:00:210
398373899282,22cyclictest3995968-21grep19:40:260
3983738992821,4cyclictest0-21swapper/019:20:250
3983738992818,7cyclictest4093776-21grep00:25:280
398373899281,24cyclictest4031956-21unixbench_multi21:25:260
3983750992720,4cyclictest0-21swapper/319:55:193
3983747992721,3cyclictest0-21swapper/219:55:272
3983747992718,7cyclictest4006514-21kworker/u8:1+events_unbound20:56:382
3983747992718,7cyclictest4006514-21kworker/u8:1+events_unbound20:56:372
3983747992718,6cyclictest0-21swapper/221:45:272
3983747992718,6cyclictest0-21swapper/220:10:022
3983738992719,4cyclictest0-21swapper/021:50:000
3983738992718,6cyclictest53-21kcompactd000:15:150
398373899271,6cyclictest4079474-21ntp_kernel_pll_23:45:210
3983750992620,3cyclictest0-21swapper/321:30:233
3983750992619,4cyclictest391ktimers/300:13:053
3983750992619,4cyclictest0-21swapper/300:05:173
3983750992618,4cyclictest0-21swapper/323:10:253
3983750992618,4cyclictest0-21swapper/300:20:253
3983747992618,5cyclictest0-21swapper/223:40:002
3983747992618,5cyclictest0-21swapper/221:40:262
3983738992620,4cyclictest4054825-21idleruntime-cro22:35:010
3983738992619,4cyclictest4081634-21tail23:50:240
3983738992619,4cyclictest0-21swapper/000:30:260
3983738992616,7cyclictest4077458-21tune2fs23:40:160
3983738992615,7cyclictest0-21swapper/023:05:200
3983738992615,7cyclictest0-21swapper/000:05:000
3983750992519,3cyclictest0-21swapper/319:25:013
3983750992518,5cyclictest0-21swapper/321:55:163
3983750992517,6cyclictest3998171-21latency_hist19:50:013
3983750992517,6cyclictest3998171-21latency_hist19:50:013
3983750992517,4cyclictest0-21swapper/319:55:013
3983750992513,9cyclictest391ktimers/322:20:143
3983747992519,4cyclictest4061362-21kworker/u8:2+events_unbound23:22:052
3983747992518,3cyclictest0-21swapper/219:40:272
3983738992518,4cyclictest438-21cron20:25:020
3983738992518,4cyclictest0-21swapper/022:55:000
3983738992518,4cyclictest0-21swapper/021:50:250
3983738992515,7cyclictest4006183-21ls20:10:250
3983750992418,3cyclictest0-21swapper/321:35:143
3983750992416,5cyclictest0-21swapper/323:20:003
3983750992416,5cyclictest0-21swapper/322:55:003
3983750992416,5cyclictest0-21swapper/322:45:153
3983750992415,5cyclictest0-21swapper/322:15:263
3983750992415,5cyclictest0-21swapper/322:15:263
3983750992413,8cyclictest4022548-21df_inode21:00:163
3983747992418,3cyclictest0-21swapper/221:50:182
3983747992418,3cyclictest0-21swapper/200:05:002
3983747992416,5cyclictest0-21swapper/219:35:242
3983747992413,8cyclictest3999932-21dpkg19:55:012
3983738992417,4cyclictest0-21swapper/020:50:200
3983738992417,3cyclictest0-21swapper/023:57:040
3983738992417,3cyclictest0-21swapper/022:55:590
3983738992417,3cyclictest0-21swapper/021:00:280
398373899241,5cyclictest4048217-21apt-get22:15:130
398373899241,5cyclictest4048217-21apt-get22:15:130
3983738992415,7cyclictest4003914-21ls20:05:170
398373899241,19cyclictest0-21swapper/023:37:000
398373899241,19cyclictest0-21swapper/021:41:360
398373899241,19cyclictest0-21swapper/020:32:260
398373899241,19cyclictest0-21swapper/000:08:490
3983750992316,4cyclictest0-21swapper/320:00:263
3983750992316,4cyclictest0-21swapper/319:20:013
3983747992316,3cyclictest0-21swapper/223:40:262
3983747992315,4cyclictest3989729-21latency_hist19:25:012
3983738992316,3cyclictest0-21swapper/019:46:000
3983738992316,3cyclictest0-21swapper/019:46:000
398373899231,18cyclictest0-21swapper/022:21:390
398373899231,18cyclictest0-21swapper/021:34:130
398373899231,18cyclictest0-21swapper/020:47:250
398373899231,18cyclictest0-21swapper/020:42:550
398373899230,19cyclictest0-21swapper/022:09:380
3983750992217,2cyclictest0-21swapper/320:50:013
3983750992216,3cyclictest0-21swapper/321:50:173
3983750992216,3cyclictest0-21swapper/320:30:193
3983750992215,4cyclictest4019152-21fschecks_count20:50:163
3983750992215,4cyclictest0-21swapper/323:55:253
3983750992215,3cyclictest0-21swapper/323:05:203
3983750992215,3cyclictest0-21swapper/322:05:153
3983750992213,5cyclictest0-21swapper/300:40:003
3983750992211,8cyclictest4080799-21cut23:50:163
3983747992214,5cyclictest0-21swapper/200:15:002
3983747992211,8cyclictest4086593-21grep00:05:232
398373899221,4cyclictest4002549-21ntp_states20:00:220
3983738992213,6cyclictest4056920-21uniq22:40:170
398373899220,18cyclictest0-21swapper/023:03:480
3983750992116,3cyclictest0-21swapper/320:45:013
3983750992114,4cyclictest4074013-21fschecks_time23:30:153
3983750992114,4cyclictest4037576-21latency_hist21:45:013
3983750992114,4cyclictest0-21swapper/319:30:273
3983750992113,5cyclictest0-21swapper/320:20:273
3983750992112,6cyclictest3995466-21awk19:40:203
3983750992111,7cyclictest4063335-21sendmail23:00:003
3983747992114,5cyclictest4043103-21kworker/u8:1+events_unbound22:06:492
3983747992114,4cyclictest0-21swapper/222:10:262
398373899210,3cyclictest0-21swapper/021:22:060
398375099201,16cyclictest4092795-21chrt00:25:143
3983750992011,6cyclictest4064175-21open_inodes23:00:243
398375099200,12cyclictest0-21swapper/300:33:293
398374799202,14cyclictest4003007-21head20:00:262
3983747992014,3cyclictest0-21swapper/220:45:232
398375099199,7cyclictest4078899-21date23:45:023
398375099199,7cyclictest4011055-21cat20:25:223
3983750991913,3cyclictest0-21swapper/322:00:173
3983750991912,5cyclictest391ktimers/322:30:143
3983750991911,5cyclictest4015399-21awk20:40:003
3983747991912,5cyclictest311ktimers/222:35:152
3983750991811,5cyclictest391ktimers/321:05:223
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional