You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-03 - 04:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot5s.osadl.org (updated Fri Jul 03, 2026 00:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3937007995019,12cyclictest3971854-21cron20:50:001
3937002994533,10cyclictest121ktimers/000:35:110
3937011994438,4cyclictest4027313-21kworker/u8:0+events_unbound23:48:232
3937011994337,4cyclictest4030347-21kworker/u8:1+events_unbound23:58:242
3937011994335,6cyclictest4011929-21kworker/u8:1+events_unbound22:48:042
3937007994316,9cyclictest3979696-21ntp_states21:10:201
3937011994236,4cyclictest4018501-21kworker/u8:0+events_unbound23:23:122
3937011994231,4cyclictest3999793-21kworker/u8:2+events_unbound22:18:012
3937002994235,4cyclictest4037687-21apt-config00:00:010
3937007994126,11cyclictest4029600-21/usr/sbin/munin23:35:181
3937014994033,4cyclictest3994697-21http21:55:013
3937011994034,4cyclictest3936652-21kworker/u8:3+events_unbound19:12:312
3937007994031,4cyclictest0-21swapper/100:08:241
3937007994013,10cyclictest4015473-21cat22:55:011
3937007993932,4cyclictest3970154-21cron20:45:011
3937007993931,5cyclictest3963344-21idleruntime-cro20:25:001
3937007993910,11cyclictest3942887-21/usr/sbin/munin19:25:251
3937011993826,8cyclictest301rcuc/221:15:002
3937007993828,4cyclictest3974005-21apt-get20:55:111
3937007993824,10cyclictest3990715-21cron21:41:001
3937007993823,10cyclictest0-21swapper/120:05:121
3937014993728,4cyclictest0-21swapper/300:25:193
3937011993731,4cyclictest3987271-21kworker/u8:1+events_unbound21:34:412
3937011993730,5cyclictest4006514-21kworker/u8:1+events_unbound22:26:412
3937011993720,9cyclictest131rcu_preempt22:00:262
3937011993718,4cyclictest0-21swapper/223:18:142
3937011993718,16cyclictest311ktimers/221:53:592
3937011993713,16cyclictest3936995-21cyclictest22:35:162
3937007993726,8cyclictest4012238-21/usr/sbin/munin22:45:141
3937007993726,7cyclictest4035021-21/usr/sbin/munin23:50:231
3937007993726,7cyclictest4015704-21/usr/sbin/munin22:55:161
3937007993726,7cyclictest4003932-21/usr/sbin/munin22:20:181
3937007993725,7cyclictest4036493-21/usr/sbin/munin23:55:201
3937007993720,3cyclictest4022854-21memory23:15:201
3937007993713,11cyclictest3941570-21expr19:20:201
3937007993711,9cyclictest4046560-21egrep00:25:171
3937011993621,10cyclictest301rcuc/220:30:002
3937007993627,6cyclictest4011011-21/usr/sbin/munin22:40:211
3937007993626,6cyclictest4041377-21/usr/sbin/munin00:10:221
3937007993625,7cyclictest4008895-21/usr/sbin/munin22:35:141
3937007993625,7cyclictest3995707-21/usr/sbin/munin21:55:221
3937007993625,7cyclictest3993746-21/usr/sbin/munin21:50:221
3937007993624,9cyclictest4032074-21cron23:41:001
3937002993628,6cyclictest4029006-21grep23:35:000
3937002993626,7cyclictest4009796-21head22:35:270
3937002993626,6cyclictest0-21swapper/022:20:000
3937014993527,4cyclictest0-21swapper/323:00:213
3937011993524,7cyclictest3954599-21sendmail20:00:002
3937011993516,4cyclictest0-21swapper/220:58:152
3937011993514,9cyclictest131rcu_preempt00:25:182
3937007993529,3cyclictest3984468-21apt-get21:25:131
3937007993526,6cyclictest3955853-21/usr/sbin/munin20:00:261
3937007993526,5cyclictest0-21swapper/123:05:161
3937007993525,7cyclictest4018510-21cron23:02:001
3937007993525,7cyclictest4002046-21/usr/sbin/munin22:15:151
3937007993525,7cyclictest3992556-21sshd21:47:411
3937007993525,7cyclictest3986287-21/usr/sbin/munin21:30:151
3937007993525,7cyclictest3976244-21/usr/sbin/munin21:00:221
3937007993525,7cyclictest3976244-21/usr/sbin/munin21:00:221
3937007993524,8cyclictest4043421-21/usr/sbin/munin00:15:191
3937007993524,8cyclictest4043421-21/usr/sbin/munin00:15:181
3937007993524,7cyclictest4020816-21/usr/sbin/munin23:10:131
3937007993516,15cyclictest3954018-21grep19:55:241
3937014993425,4cyclictest0-21swapper/322:50:273
3937014993423,7cyclictest4002987-21grep22:15:263
3937014993423,7cyclictest0-21swapper/323:55:263
393701199346,17cyclictest32-21ksoftirqd/221:20:012
3937011993425,5cyclictest0-21swapper/220:10:252
3937011993425,5cyclictest0-21swapper/220:10:242
3937011993424,6cyclictest0-21swapper/223:10:242
3937011993423,5cyclictest3999793-21kworker/u8:2+events_unbound22:34:432
3937011993415,12cyclictest131rcu_preempt23:05:212
3937007993427,4cyclictest3996835-21apt-get22:00:131
3937007993425,6cyclictest3978403-21/usr/sbin/munin21:05:261
3937007993424,7cyclictest3972536-21/usr/sbin/munin20:50:161
3937007993424,7cyclictest3951091-21cron19:49:001
3937007993424,7cyclictest3949137-21cron19:41:001
3937007993424,7cyclictest3939300-21meminfo19:15:031
3937007993424,6cyclictest3963566-21apt-get20:25:101
3937007993423,8cyclictest3999744-21cron22:07:001
3937007993423,8cyclictest3999744-21cron22:07:001
3937007993422,9cyclictest4000577-21/usr/sbin/munin22:10:171
3937007993422,7cyclictest3981121-21/usr/sbin/munin21:15:181
3937007993421,10cyclictest3987869-21/usr/sbin/munin21:35:221
3937007993419,11cyclictest3965842-21chrt20:30:221
3937002993425,6cyclictest4035350-21grep23:50:260
3937002993425,6cyclictest0-21swapper/022:00:000
3937002993422,8cyclictest3990657-21grep21:40:260
3937014993324,4cyclictest0-21swapper/300:33:323
393701199338,18cyclictest32-21ksoftirqd/221:00:272
393701199338,18cyclictest32-21ksoftirqd/221:00:272
3937011993325,5cyclictest301rcuc/221:45:142
3937011993324,6cyclictest3946453-21fschecks_count19:35:162
3937011993318,5cyclictest131rcu_preempt19:42:522
3937011993316,8cyclictest131rcu_preempt00:10:152
3937011993315,4cyclictest131rcu_preempt22:53:152
3937011993315,4cyclictest131rcu_preempt19:29:552
3937011993313,10cyclictest131rcu_preempt20:40:222
3937007993326,3cyclictest3960142-21apt-get20:15:111
3937007993324,6cyclictest3937397-21/usr/sbin/munin19:10:181
3937007993323,7cyclictest4045251-21meminfo00:20:191
3937007993323,7cyclictest4006438-21users22:25:261
3937007993323,7cyclictest3967490-21/usr/sbin/munin20:35:211
3937007993323,7cyclictest3958533-21/usr/sbin/munin20:10:141
3937007993323,7cyclictest3958533-21/usr/sbin/munin20:10:131
3937007993323,7cyclictest3945716-21cron19:31:011
3937007993321,8cyclictest4027524-21/usr/sbin/munin23:30:161
3937007993321,7cyclictest3982661-21df21:20:161
3937007993320,10cyclictest4026550-21sendmail_mailtr23:25:251
3937007993320,10cyclictest4026550-21sendmail_mailtr23:25:241
3937007993319,10cyclictest4024301-21fschecks_count23:20:161
3937007993316,14cyclictest4032762-21df_inode23:45:171
3937007993316,12cyclictest4049665-21cron00:35:001
3937002993325,5cyclictest0-21swapper/020:45:010
3937002993325,4cyclictest0-21swapper/022:05:240
3937002993325,4cyclictest0-21swapper/022:05:240
3937002993324,5cyclictest0-21swapper/023:45:000
3937014993224,4cyclictest0-21swapper/321:40:013
3937014993224,4cyclictest0-21swapper/320:55:253
3937014993224,4cyclictest0-21swapper/300:10:153
3937014993222,7cyclictest4009758-21tail22:35:273
3937014993222,7cyclictest3984101-21latency_hist21:25:013
393701199329,7cyclictest32-21ksoftirqd/200:40:012
3937011993223,4cyclictest0-21swapper/222:40:252
3937011993222,6cyclictest0-21swapper/223:50:262
3937011993221,5cyclictest131rcu_preempt23:00:312
3937011993220,8cyclictest311ktimers/223:00:002
3937011993220,8cyclictest301rcuc/223:39:592
3937011993218,5cyclictest3982038-21kworker/u8:0+events_unbound21:24:492
3937011993216,9cyclictest131rcu_preempt19:15:142
3937011993215,14cyclictest311ktimers/223:42:472
3937011993214,9cyclictest131rcu_preempt21:05:252
3937011993214,9cyclictest131rcu_preempt20:52:432
3937011993211,5cyclictest131rcu_preempt20:35:252
3937011993210,14cyclictest32-21ksoftirqd/200:30:262
3937007993226,3cyclictest4050117-21apt-get00:35:111
3937007993226,3cyclictest4037979-21apt-get00:00:131
3937007993222,7cyclictest3947014-21/usr/sbin/munin19:35:231
3937007993220,9cyclictest4007626-21ntp_states22:30:211
3937002993223,4cyclictest0-21swapper/023:05:140
3937002993222,7cyclictest4030229-21grep23:35:260
3937002993222,7cyclictest3977811-21sort21:05:200
3937002993222,6cyclictest0-21swapper/022:15:000
3937002993222,6cyclictest0-21swapper/021:25:160
3937014993124,5cyclictest199-21systemd-network22:05:233
3937014993124,5cyclictest199-21systemd-network22:05:233
393701199319,13cyclictest32-21ksoftirqd/200:05:212
393701199319,11cyclictest32-21ksoftirqd/219:45:252
3937011993123,4cyclictest0-21swapper/200:00:152
3937011993121,4cyclictest131rcu_preempt19:51:002
3937011993120,8cyclictest311ktimers/220:45:112
3937011993119,4cyclictest131rcu_preempt20:20:232
3937011993117,4cyclictest131rcu_preempt20:05:172
3937011993115,4cyclictest131rcu_preempt19:20:202
3937011993114,9cyclictest131rcu_preempt20:00:182
3937011993113,10cyclictest131rcu_preempt21:40:112
3937011993112,11cyclictest131rcu_preempt19:30:112
3937011993112,11cyclictest0-21swapper/220:30:272
3937011993111,4cyclictest131rcu_preempt23:31:522
3937011993110,5cyclictest131rcu_preempt00:20:002
3937011993110,5cyclictest131rcu_preempt00:20:002
3937002993123,5cyclictest0-21swapper/021:55:000
3937002993123,4cyclictest0-21swapper/021:20:000
3937002993122,5cyclictest4014921-21grep22:50:270
3937002993121,6cyclictest0-21swapper/021:25:010
3937002993120,7cyclictest0-21swapper/019:40:020
3937014993024,4cyclictest4029009-21idleruntime-cro23:35:003
3937014993023,4cyclictest4034561-21cut23:50:163
3937014993023,4cyclictest0-21swapper/319:55:253
3937014993022,4cyclictest0-21swapper/321:15:273
3937014993022,4cyclictest0-21swapper/319:47:353
3937014993020,6cyclictest0-21swapper/323:30:003
3937014993020,6cyclictest0-21swapper/323:30:003
393701199309,14cyclictest0-21swapper/221:35:162
3937011993020,7cyclictest311ktimers/222:05:202
3937011993020,7cyclictest311ktimers/222:05:192
3937011993015,3cyclictest131rcu_preempt22:10:182
3937011993013,10cyclictest131rcu_preempt21:55:012
3937011993012,5cyclictest131rcu_preempt20:15:182
3937011993010,3cyclictest131rcu_preempt00:22:102
3937002993023,4cyclictest0-21swapper/023:25:260
3937002993023,4cyclictest0-21swapper/023:25:260
3937002993023,4cyclictest0-21swapper/023:00:000
3937002993023,3cyclictest0-21swapper/020:25:250
3937002993022,5cyclictest0-21swapper/020:50:010
3937002993022,5cyclictest0-21swapper/000:24:590
3937002993019,8cyclictest3942232-21grep19:20:270
3937002993017,10cyclictest121ktimers/000:30:120
3937014992923,4cyclictest3919992-21kworker/u8:1+events_unbound19:22:333
3937014992922,4cyclictest4030347-21kworker/u8:1+events_unbound23:38:163
3937014992922,4cyclictest0-21swapper/323:10:243
3937014992922,3cyclictest0-21swapper/319:15:023
3937011992913,9cyclictest131rcu_preempt23:25:142
3937011992913,9cyclictest131rcu_preempt23:25:132
3937011992911,10cyclictest131rcu_preempt21:25:022
3937002992923,3cyclictest0-21swapper/000:30:000
3937002992921,5cyclictest0-21swapper/019:55:000
3937014992821,4cyclictest0-21swapper/319:30:013
3937002992823,3cyclictest13550irq/42-30be0000.ethernet20:10:190
3937002992823,3cyclictest13550irq/42-30be0000.ethernet20:10:190
3937002992822,4cyclictest3968451-21sendmail20:40:010
3937002992819,6cyclictest0-21swapper/020:00:250
3937014992721,3cyclictest0-21swapper/320:50:023
3937014992721,3cyclictest0-21swapper/319:40:243
3937014992719,6cyclictest4039454-21latency_hist00:05:003
3937014992719,4cyclictest0-21swapper/319:55:003
3937014992718,6cyclictest0-21swapper/323:45:273
3937014992718,6cyclictest0-21swapper/322:00:283
3937014992717,6cyclictest0-21swapper/320:00:263
3937014992715,9cyclictest3944590-21apt-get19:30:113
393700299274,21cyclictest4023464-21unixbench_singl23:15:270
3937002992718,6cyclictest0-21swapper/021:45:260
3937014992619,3cyclictest0-21swapper/321:10:253
3937014992618,4cyclictest0-21swapper/320:10:153
3937014992618,4cyclictest0-21swapper/320:10:153
3937014992614,7cyclictest4040701-21grep00:05:273
393700299265,18cyclictest0-21swapper/022:30:370
3937002992620,4cyclictest3998304-21auditctl22:05:010
3937002992620,3cyclictest0-21swapper/022:45:250
3937002992618,5cyclictest0-21swapper/022:25:010
3937002992618,5cyclictest0-21swapper/000:20:000
3937002992618,5cyclictest0-21swapper/000:20:000
3937002992617,4cyclictest0-21swapper/019:57:360
393700299261,5cyclictest39508242sleep019:45:500
3937002992615,8cyclictest4038984-21grep00:00:290
3937002992615,7cyclictest3938778-21munin-node19:15:010
3937014992519,3cyclictest0-21swapper/321:30:283
3937014992518,4cyclictest0-21swapper/323:20:253
3937014992518,4cyclictest0-21swapper/320:20:283
3937014992518,3cyclictest0-21swapper/300:20:263
3937014992517,4cyclictest0-21swapper/321:55:163
3937002992516,5cyclictest0-21swapper/020:50:250
3937002992515,7cyclictest204-21dbus-daemon19:27:320
3937014992418,3cyclictest3973915-21latency_hist20:55:013
3937014992416,6cyclictest4031480-21ntpq23:40:203
3937014992415,6cyclictest3991780-21grep21:45:203
3937014992415,4cyclictest3968447-21sendmail20:40:013
3937014992414,7cyclictest3965047-21basename20:30:003
3937014992411,9cyclictest204-21dbus-daemon23:08:083
3937002992418,3cyclictest0-21swapper/019:15:020
3937002992417,4cyclictest4005522-21sort22:25:150
3937002992417,4cyclictest121ktimers/023:20:110
3937002992417,3cyclictest0-21swapper/000:11:470
3937002992413,7cyclictest4033654-21grep23:45:270
3937002992413,7cyclictest3961155-21grep20:15:240
3937014992316,4cyclictest3946827-21ntpq19:35:213
3937014992315,4cyclictest3939602-21fschecks_count19:15:163
3937014992315,4cyclictest0-21swapper/322:25:163
3937014992313,7cyclictest3975837-21df_inode21:00:153
3937014992313,7cyclictest3975837-21df_inode21:00:153
3937014992312,8cyclictest3960939-21sed20:15:233
3937014992311,9cyclictest1-21systemd00:18:273
3937014992311,9cyclictest1-21systemd00:18:273
3937002992317,2cyclictest0-21swapper/022:41:110
3937002992316,5cyclictest121ktimers/020:20:240
3937002992315,4cyclictest0-21swapper/021:15:000
3937002992314,5cyclictest3986371-21tune2fs21:30:180
3937002992314,5cyclictest0-21swapper/019:31:330
393700299231,3cyclictest4039683-21apt-get00:05:120
393700299231,3cyclictest39566452sleep020:05:140
393700299231,18cyclictest0-21swapper/021:02:140
393700299231,18cyclictest0-21swapper/021:02:140
3937014992216,3cyclictest0-21swapper/322:20:163
3937014992216,3cyclictest0-21swapper/320:05:203
3937014992215,5cyclictest3962953-21kworker/u8:1+events_unbound20:30:353
3937014992215,5cyclictest391ktimers/322:45:133
3937014992214,5cyclictest391ktimers/320:40:193
3937014992214,4cyclictest4016588-21tail22:55:263
3937014992213,5cyclictest3991073-21munin-plugin-st21:45:003
3937014992212,7cyclictest3985933-21sh21:30:003
393700299221,8cyclictest3974113-21df20:55:130
3937002992214,5cyclictest3966268-21tail20:30:260
3937002992214,5cyclictest0-21swapper/019:40:140
393700299220,20cyclictest0-21swapper/021:35:240
393700299220,18cyclictest0-21swapper/023:03:010
3937014992114,5cyclictest0-21swapper/300:35:263
3937014992113,5cyclictest0-21swapper/322:40:243
3937002992115,4cyclictest3933072-1kworker/0:1H+mmc_complete23:15:000
3937014992012,5cyclictest391ktimers/323:15:233
393701499201,13cyclictest1-21systemd21:07:503
3937014992010,7cyclictest4000800-21ntp_states22:10:203
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional