You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-27 - 03:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot5s.osadl.org (updated Mon Jul 27, 2026 00:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
782731995243,5cyclictest818029-21munin-plugin-st20:50:000
782736994942,4cyclictest805855-21cron20:15:011
782736994942,4cyclictest805855-21cron20:15:001
782739994740,4cyclictest862589-21munin-plugin-st23:00:002
782744994634,9cyclictest391ktimers/321:35:153
782739994626,17cyclictest793050-21unixbench_multi19:35:292
782739994619,23cyclictest819284-21grep20:50:272
782744994530,11cyclictest391ktimers/320:20:133
782739994332,8cyclictest800547-21sendmail20:00:002
78273999431,9cyclictest873834-21/usr/sbin/munin23:30:222
78273999431,10cyclictest854964-21/usr/sbin/munin22:35:252
782731994332,7cyclictest860412-21grep22:50:230
78273999421,8cyclictest889183-21/usr/sbin/munin00:15:212
78273999421,10cyclictest825779-21/usr/sbin/munin21:10:252
782736994233,6cyclictest838252-21grep21:45:261
782744994128,10cyclictest391ktimers/322:40:143
782739994130,8cyclictest311ktimers/200:25:162
78273999412,7cyclictest881793-21apt-get23:55:142
782739994122,15cyclictest0-21swapper/221:45:172
78273999411,9cyclictest865474-21/usr/sbin/munin23:05:262
78273999411,9cyclictest834161-21irqstats21:35:202
78273999411,9cyclictest796730-21/usr/sbin/munin19:45:262
78273999411,8cyclictest839915-21/usr/sbin/munin21:50:242
78273999411,6cyclictest873200-21latency_hist23:30:002
78273999411,3cyclictest830421-21apt-get21:25:142
78273999411,10cyclictest829443-21/usr/sbin/munin21:20:262
78273999411,10cyclictest814199-21head20:35:272
782736994125,12cyclictest231ktimers/119:15:131
782731994129,8cyclictest807580-21idleruntime-cro20:20:000
782731994129,8cyclictest807580-21idleruntime-cro20:20:000
782744994029,7cyclictest0-21swapper/319:50:253
78273999403,4cyclictest816998-21meminfo20:45:182
78273999402,4cyclictest806857-21/usr/sbin/munin20:15:252
78273999402,4cyclictest806857-21/usr/sbin/munin20:15:252
78273999402,11cyclictest853638-21grep22:30:272
78273999401,9cyclictest822806-21cron21:01:002
78273999401,9cyclictest822806-21cron21:01:002
78273999401,9cyclictest810639-21/usr/sbin/munin20:25:242
78273999401,8cyclictest844905-21/usr/sbin/munin22:05:232
78273999401,8cyclictest823778-21/usr/sbin/munin21:05:192
78273999401,5cyclictest885977-21/usr/sbin/munin00:05:252
782731994033,4cyclictest842123-21audit_send_reply22:00:000
78273999398,28cyclictest848133-21/usr/sbin/munin22:15:232
78273999392,3cyclictest840639-21/usr/sbin/munin21:55:112
78273999391,8cyclictest803291-21/usr/sbin/munin20:05:242
78273999391,7cyclictest877014-21/usr/sbin/munin23:40:182
78273999391,6cyclictest785545-21/usr/sbin/munin19:15:202
78273999391,5cyclictest896069-21/usr/sbin/munin00:35:212
78273999391,5cyclictest890798-21memory00:20:202
78273999391,5cyclictest879516-21cron23:46:002
78273999391,5cyclictest858048-21irqstats22:45:172
782739993912,24cyclictest784657-21latency_hist19:15:022
78273999391,11cyclictest828291-21basename21:20:012
78273999391,10cyclictest875299-21/usr/sbin/munin23:35:192
782731993929,6cyclictest0-21swapper/019:25:000
782744993827,7cyclictest0-21swapper/322:55:253
78273999383,4cyclictest808894-21users20:20:262
782739993827,7cyclictest0-21swapper/221:30:252
78273999382,6cyclictest801846-21expr20:00:262
78273999382,4cyclictest849187-21apt-get22:20:122
78273999381,9cyclictest835988-21/usr/sbin/munin21:40:202
78273999381,7cyclictest794068-21/usr/sbin/munin19:40:152
78273999381,6cyclictest859407-21/usr/sbin/munin22:50:242
78273999381,6cyclictest842994-21/usr/sbin/munin22:00:242
78273999381,5cyclictest880669-21/usr/sbin/munin23:50:212
78273999381,5cyclictest851009-21diskstats22:25:162
78273999381,5cyclictest851009-21diskstats22:25:162
78273999381,4cyclictest870137-21/usr/sbin/munin23:20:202
78273999381,4cyclictest856344-21/usr/sbin/munin22:40:182
78273999381,4cyclictest820393-21/usr/sbin/munin20:55:182
78273999381,4cyclictest791236-21/usr/sbin/munin19:30:252
782736993828,7cyclictest889685-21unixbench_singl00:15:261
782744993730,4cyclictest0-21swapper/323:55:003
78273999379,25cyclictest805017-21/usr/sbin/munin20:10:242
78273999379,25cyclictest805017-21/usr/sbin/munin20:10:242
78273999372,4cyclictest815252-21/usr/sbin/munin20:40:192
78273999371,8cyclictest866795-21ntp_states23:10:192
78273999371,4cyclictest863395-21/usr/sbin/munin23:00:222
78273999371,4cyclictest811675-21/usr/sbin/munin20:30:162
78273999371,3cyclictest786924-21apt-get19:20:112
78273999370,7cyclictest788624-21/usr/sbin/munin19:25:122
782736993730,4cyclictest819715-21cron20:55:001
782736993728,5cyclictest0-21swapper/119:55:151
782731993726,6cyclictest0-21swapper/022:40:260
782744993629,4cyclictest848945-21munin-plugin-st22:20:003
782744993626,7cyclictest817608-21grep20:45:253
78273999361,3cyclictest895050-21cron00:33:002
78273999361,3cyclictest895050-21cron00:33:002
78273999361,3cyclictest887586-21/usr/sbin/munin00:10:252
78273999361,10cyclictest868051-21diskstats23:15:142
782736993627,6cyclictest231ktimers/119:35:141
782744993525,6cyclictest0-21swapper/323:40:263
782744993525,6cyclictest0-21swapper/323:00:253
782744993525,6cyclictest0-21swapper/300:25:003
782744993523,7cyclictest807080-21grep20:15:273
782744993523,7cyclictest807080-21grep20:15:263
782744993521,11cyclictest391ktimers/300:15:143
782736993525,6cyclictest812900-21auditctl20:35:001
782744993426,4cyclictest0-21swapper/320:40:183
782744993424,6cyclictest0-21swapper/320:55:003
782744993423,7cyclictest0-21swapper/321:50:243
782739993424,6cyclictest311ktimers/222:10:132
78273999341,8cyclictest884205-21fgrep00:00:242
78273999340,4cyclictest0-21swapper/219:50:122
782736993426,4cyclictest0-21swapper/120:55:251
782736993423,7cyclictest0-21swapper/122:15:261
782731993427,5cyclictest800206-21kworker/u8:0+events_unbound20:00:460
782731993424,6cyclictest0-21swapper/022:15:000
782744993324,4cyclictest0-21swapper/320:00:173
782736993320,8cyclictest0-21swapper/123:15:241
782731993325,6cyclictest889977-21kworker/u8:3+events_unbound00:33:440
782731993325,6cyclictest889977-21kworker/u8:3+events_unbound00:33:440
782731993325,4cyclictest0-21swapper/023:21:260
782731993324,6cyclictest826138-21grep21:10:260
782731993323,6cyclictest0-21swapper/019:25:170
782731993322,8cyclictest121ktimers/022:35:140
782744993224,5cyclictest0-21swapper/323:55:253
782744993222,6cyclictest0-21swapper/300:35:243
782744993221,7cyclictest0-21swapper/322:30:263
782744993220,7cyclictest0-21swapper/319:45:253
782736993225,5cyclictest886057-21kworker/u8:2+events_unbound00:08:221
782736993223,6cyclictest0-21swapper/100:40:001
782736993222,5cyclictest0-21swapper/122:05:241
782736993221,8cyclictest834857-21grep21:35:281
782736993221,7cyclictest789612-21grep19:25:261
782736993221,7cyclictest0-21swapper/100:10:281
782731993226,4cyclictest784370-21latency_hist19:15:000
782731993224,5cyclictest874734-21sh23:35:000
782731993224,4cyclictest0-21swapper/021:35:280
782744993123,4cyclictest0-21swapper/320:05:183
782744993122,5cyclictest0-21swapper/322:20:253
782744993121,6cyclictest0-21swapper/322:25:273
782744993121,6cyclictest0-21swapper/322:25:263
782744993120,6cyclictest0-21swapper/319:25:003
782736993123,4cyclictest0-21swapper/121:55:181
782736993123,4cyclictest0-21swapper/121:00:231
782736993123,4cyclictest0-21swapper/121:00:231
782731993124,4cyclictest805863-21cron20:15:000
782731993124,4cyclictest805863-21cron20:15:000
782731993121,6cyclictest845058-21grep22:05:240
782731993121,6cyclictest0-21swapper/000:15:000
782731993118,10cyclictest0-21swapper/019:40:010
782744993024,4cyclictest886057-21kworker/u8:2+events_unbound00:12:403
782744993023,4cyclictest0-21swapper/319:40:253
782744993023,3cyclictest0-21swapper/323:20:013
782736993024,4cyclictest822917-21kworker/u8:0+events_unbound21:06:001
782736993023,4cyclictest0-21swapper/119:10:161
782736993022,4cyclictest0-21swapper/120:15:161
782736993022,4cyclictest0-21swapper/120:15:161
782736993021,5cyclictest863844-21tail23:00:251
782736993016,7cyclictest848670-21kworker/u8:2+events_unbound22:26:391
782736993016,7cyclictest848670-21kworker/u8:2+events_unbound22:26:391
78273699301,5cyclictest131rcu_preempt20:45:111
782731993021,6cyclictest814622-21sendmail20:40:010
782731993021,5cyclictest893546-21runrttasks00:30:000
782744992919,6cyclictest0-21swapper/323:35:003
782744992918,6cyclictest0-21swapper/319:30:013
78273699292,4cyclictest131rcu_preempt23:20:121
782736992922,4cyclictest0-21swapper/122:00:271
782736992920,6cyclictest793473-21kworker/u8:0+events_unbound19:40:061
782736992919,7cyclictest231ktimers/119:20:121
782731992921,4cyclictest13550irq/42-30be0000.ethernet23:40:000
782731992921,4cyclictest0-21swapper/023:55:000
782731992919,6cyclictest0-21swapper/021:55:000
782731992919,6cyclictest0-21swapper/000:05:260
782731992915,9cyclictest819713-21cron20:55:000
782744992820,5cyclictest793496-21apt-get19:40:013
782744992820,4cyclictest0-21swapper/320:00:023
782744992818,6cyclictest0-21swapper/300:30:003
782736992821,3cyclictest855792-21kworker/u8:322:40:001
782736992820,5cyclictest0-21swapper/100:25:251
782736992820,4cyclictest0-21swapper/120:25:001
782736992819,6cyclictest0-21swapper/123:05:281
782736992819,5cyclictest0-21swapper/123:26:261
782731992822,3cyclictest0-21swapper/023:10:000
782731992821,4cyclictest0-21swapper/021:40:260
782731992820,6cyclictest121ktimers/022:00:130
782731992820,4cyclictest0-21swapper/023:55:250
782731992820,4cyclictest0-21swapper/020:20:250
782731992819,6cyclictest0-21swapper/021:20:010
782731992818,6cyclictest0-21swapper/021:00:000
782731992818,6cyclictest0-21swapper/000:40:010
782744992716,7cyclictest0-21swapper/322:05:243
782744992714,9cyclictest0-21swapper/323:25:183
782736992719,4cyclictest0-21swapper/121:40:161
782736992715,9cyclictest204-21dbus-daemon23:41:321
782731992720,3cyclictest0-21swapper/021:30:250
782731992720,3cyclictest0-21swapper/000:15:260
782731992719,4cyclictest0-21swapper/019:55:440
782731992718,5cyclictest0-21swapper/020:30:010
782744992621,3cyclictest786421-21sh19:17:003
782744992619,4cyclictest0-21swapper/323:45:213
782744992619,4cyclictest0-21swapper/322:50:243
782744992618,6cyclictest145-21jbd2/mmcblk1p2-821:40:173
782744992617,6cyclictest0-21swapper/321:20:013
78274499261,5cyclictest0-21swapper/321:57:593
782736992619,5cyclictest850418-21kworker/u8:0+events_unbound22:24:431
782736992618,4cyclictest0-21swapper/123:10:241
782736992618,4cyclictest0-21swapper/120:40:261
782731992620,3cyclictest0-21swapper/023:45:000
782731992618,4cyclictest0-21swapper/020:35:000
782731992616,6cyclictest0-21swapper/019:50:250
782744992518,5cyclictest862514-21kworker/u8:1+events_unbound23:11:253
782744992518,4cyclictest830187-21auditctl21:25:003
782744992518,4cyclictest0-21swapper/319:30:263
782744992517,5cyclictest0-21swapper/323:10:003
782744992517,4cyclictest0-21swapper/322:50:013
782744992516,6cyclictest0-21swapper/320:30:253
78273699258,4cyclictest131rcu_preempt23:55:251
78273699252,4cyclictest131rcu_preempt23:35:151
782736992519,4cyclictest876070-21kworker/u8:2+events_unbound23:54:181
782736992519,3cyclictest0-21swapper/121:20:261
782736992518,5cyclictest858993-21kworker/u8:0+events_unbound22:53:101
782736992518,5cyclictest810834-21kworker/u8:0+events_unbound20:30:021
782736992518,4cyclictest862163-21head22:55:251
782736992517,5cyclictest845183-21kworker/u8:1+events_unbound22:10:301
782736992517,4cyclictest0-21swapper/122:30:201
782736992517,4cyclictest0-21swapper/100:05:001
78273699251,5cyclictest131rcu_preempt19:30:121
782731992519,3cyclictest13850irq/36-mmc121:10:000
782731992517,5cyclictest0-21swapper/022:20:230
782731992517,5cyclictest0-21swapper/000:20:260
782731992517,4cyclictest0-21swapper/023:00:000
78273199251,4cyclictest786680-21munin-run19:20:000
78273199251,20cyclictest0-21swapper/019:48:580
782744992418,3cyclictest0-21swapper/320:15:003
782744992418,3cyclictest0-21swapper/320:15:003
782744992418,3cyclictest0-21swapper/300:00:243
782744992416,5cyclictest0-21swapper/319:15:003
782744992414,7cyclictest0-21swapper/323:35:233
782744992414,6cyclictest0-21swapper/321:05:273
782736992418,4cyclictest830073-21kworker/u8:0+events_unbound21:25:241
782736992418,4cyclictest821191-21kworker/u8:1+events_unbound21:11:331
782736992418,4cyclictest793473-21kworker/u8:0+events_unbound19:45:581
782731992416,6cyclictest121ktimers/021:25:250
782731992416,5cyclictest879412-21unixbench_multi23:45:260
782731992412,7cyclictest848946-21ls22:20:000
78273199241,19cyclictest0-21swapper/020:42:150
78273199241,19cyclictest0-21swapper/020:08:380
782744992317,3cyclictest8424762sleep322:00:173
782744992316,5cyclictest836973-21kworker/u8:1+events_unbound21:46:073
782744992315,4cyclictest0-21swapper/322:35:273
782744992313,6cyclictest0-21swapper/321:00:233
782744992313,6cyclictest0-21swapper/321:00:233
78273699237,4cyclictest131rcu_preempt20:05:451
782736992317,3cyclictest0-21swapper/123:30:231
782736992313,6cyclictest0-21swapper/100:30:251
782736992313,6cyclictest0-21swapper/100:30:251
782736992313,4cyclictest793473-21kworker/u8:0+events_unbound19:50:441
782736992312,7cyclictest0-21swapper/122:45:251
78273199236,10cyclictest884558-21unixbench_singl00:00:270
782731992317,3cyclictest0-21swapper/021:20:220
782731992315,5cyclictest851067-21tune2fs22:25:170
782731992315,5cyclictest851067-21tune2fs22:25:170
782731992315,5cyclictest121ktimers/023:10:210
78273199231,20cyclictest0-21swapper/022:30:160
78273199231,18cyclictest0-21swapper/023:17:090
78273199230,19cyclictest0-21swapper/021:01:440
78273199230,19cyclictest0-21swapper/021:01:430
78273199230,19cyclictest0-21swapper/019:33:220
782744992214,5cyclictest833651-21seq21:35:023
782744992214,4cyclictest0-21swapper/322:10:163
782744992212,6cyclictest0-21swapper/300:05:273
782736992217,2cyclictest0-21swapper/123:45:251
782736992216,4cyclictest839052-21kworker/u8:3+events_unbound21:54:421
782736992214,5cyclictest0-21swapper/122:40:221
782731992217,3cyclictest0-21swapper/019:40:040
782731992215,5cyclictest0-21swapper/023:28:350
782731992213,6cyclictest0-21swapper/022:45:160
78273199220,18cyclictest0-21swapper/021:47:010
782744992115,4cyclictest871158-21latency_hist23:25:013
782744992115,3cyclictest0-21swapper/300:30:253
782744992115,3cyclictest0-21swapper/300:30:253
782744992112,6cyclictest0-21swapper/320:30:013
782744992110,8cyclictest813591-21wc20:35:213
782744992110,7cyclictest204-21dbus-daemon21:10:593
78273699217,3cyclictest0-21swapper/120:38:131
782736992115,4cyclictest826323-21kworker/u8:2+events_unbound21:30:241
782736992112,6cyclictest0-21swapper/100:20:151
782736992011,6cyclictest801537-21/usr/sbin/munin20:00:221
782744991913,3cyclictest0-21swapper/321:25:123
782744991912,4cyclictest391ktimers/320:55:203
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional