You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-27 - 13:23

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot5s.osadl.org (updated Sat Dec 27, 2025 00:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3555064995445,5cyclictest3632763-21grep22:50:251
3555073995343,5cyclictest3664118-21apt00:25:003
3555060995345,5cyclictest3662390-21cron00:20:010
3555060994941,4cyclictest3556914-21cat19:15:010
3555069994733,9cyclictest311ktimers/222:10:122
3555064994633,9cyclictest3581199-21unixbench_singl20:20:251
3555069994420,19cyclictest0-21swapper/220:30:272
3555073994336,4cyclictest3556994-21ls19:15:013
3555069994336,4cyclictest3655139-21unixbench_singl23:55:262
3555069994334,5cyclictest3556257-21unixbench_singl19:10:262
355506999431,11cyclictest3615040-21ntp_states22:00:222
355506999431,10cyclictest3649000-21apt-get23:40:132
355506999431,10cyclictest3649000-21apt-get23:40:132
3555064994336,4cyclictest3579894-21munin-plugin-st20:20:001
3555060994334,6cyclictest3653405-21unixbench_multi23:50:260
3555060994334,6cyclictest3584564-21unixbench_multi20:30:270
3555060994232,6cyclictest3636152-21grep23:00:260
3555069994122,15cyclictest0-21swapper/219:50:002
3555069994122,15cyclictest0-21swapper/219:50:002
355506999411,9cyclictest3637185-21/usr/sbin/munin23:05:162
355506999411,8cyclictest3592016-21ls20:55:022
355506999411,7cyclictest3628224-21df_inode22:40:152
355506999411,7cyclictest3628224-21df_inode22:40:152
355506999403,6cyclictest3638660-21df_inode23:10:152
355506999403,5cyclictest3580472-21irqstats20:20:172
3555069994032,6cyclictest311ktimers/222:55:122
3555069994031,5cyclictest3659387-21grep00:10:172
355506999402,5cyclictest3578534-21diskstats20:15:152
355506999401,9cyclictest3658093-21ntp_states00:05:222
355506999401,9cyclictest3585294-21/usr/sbin/munin20:35:132
355506999401,9cyclictest3574010-21/usr/sbin/munin20:00:242
355506999401,7cyclictest3669088-21cron00:36:002
355506999401,7cyclictest3560135-21/usr/sbin/munin19:20:232
355506999401,5cyclictest3577793-21users20:10:252
3555069994015,22cyclictest3606073-21fschecks_count21:35:192
355506999401,10cyclictest3664463-21df_inode00:25:152
355506999401,10cyclictest3635701-21taskset23:00:222
3555060994033,4cyclictest0-21swapper/019:25:130
3555060994029,7cyclictest3563913-21unixbench_singl19:30:250
355506999393,3cyclictest3623567-21ntp_states22:25:222
355506999392,4cyclictest3622325-21/usr/sbin/munin22:20:282
355506999392,10cyclictest3605838-21wc21:35:012
355506999391,8cyclictest3663282-21/usr/sbin/munin00:20:212
355506999391,7cyclictest3609928-21/usr/sbin/munin21:45:222
355506999391,6cyclictest3625467-21/usr/sbin/munin22:30:262
355506999391,5cyclictest3589182-21/usr/sbin/munin20:45:202
355506999391,4cyclictest3632329-21/usr/sbin/munin22:50:222
355506999391,4cyclictest3565406-21/usr/sbin/munin19:35:242
3555069993911,25cyclictest3620137-21/usr/sbin/munin22:15:222
355506999391,11cyclictest3587409-21meminfo20:40:192
3555064993927,8cyclictest3627860-21cron22:40:001
3555060993929,6cyclictest3668965-21unixbench_multi00:35:240
355506999389,26cyclictest3563069-21fschecks_time19:30:152
355506999383,4cyclictest3630759-21/usr/sbin/munin22:45:282
355506999383,4cyclictest3630759-21/usr/sbin/munin22:45:282
355506999383,3cyclictest311ktimers/200:00:132
355506999382,4cyclictest3653427-21/usr/sbin/munin23:50:262
355506999382,4cyclictest3597532-21irqstats21:10:202
355506999381,9cyclictest3592165-21df20:55:142
3555069993818,16cyclictest0-21swapper/221:55:152
355506999381,5cyclictest3643992-21df_inode23:25:152
355506999381,5cyclictest3561610-21meminfo19:25:192
355506999381,4cyclictest3626499-21df22:35:152
355506999381,4cyclictest3617154-21/usr/sbin/munin22:05:262
355506999381,4cyclictest3600953-21/usr/sbin/munin21:20:132
355506999381,3cyclictest0-21swapper/200:30:132
355506999381,11cyclictest3600385-21tr21:20:002
355506999381,11cyclictest3571370-21munin-run19:55:002
355506999381,11cyclictest3571370-21munin-run19:55:002
355506999381,11cyclictest3566612-21diskstats19:40:162
355506999381,10cyclictest3640552-21if_eth123:15:172
3555064993831,4cyclictest0-21swapper/121:20:001
3555060993831,4cyclictest3627855-21cron22:40:000
3555060993830,4cyclictest0-21swapper/023:55:230
3555060993829,6cyclictest3576029-21unixbench_multi20:05:240
355506999371,5cyclictest3645699-21diskstats23:30:152
355506999371,5cyclictest3595338-21cat21:05:012
3555069993715,20cyclictest3660926-21/usr/sbin/munin00:15:172
355506999371,10cyclictest3602621-21cstates21:25:132
3555073993628,6cyclictest3598514-21kworker/u8:0+events_unbound21:26:313
3555073993626,7cyclictest3657691-21fschecks_count00:05:173
3555073993625,8cyclictest3634896-21cron23:00:013
3555073993625,7cyclictest3622346-21grep22:20:283
355506999366,25cyclictest0-21swapper/220:25:262
3555069993627,4cyclictest0-21swapper/221:50:142
3555069993625,7cyclictest3608630-21grep21:40:232
355506999361,8cyclictest3575126-21df_inode20:05:132
355506999361,4cyclictest3558332-21/usr/sbin/munin19:15:222
355506999361,3cyclictest3571726-21/usr/sbin/munin19:55:162
355506999361,3cyclictest3571726-21/usr/sbin/munin19:55:162
3555064993626,6cyclictest0-21swapper/119:15:011
3555064993613,6cyclictest3609925-21sh21:45:221
3555060993629,4cyclictest3596959-21munin-plugin-st21:10:000
3555060993628,5cyclictest3667804-21apt-config00:35:020
3555060993626,5cyclictest0-21swapper/023:30:250
3555073993527,4cyclictest0-21swapper/319:21:093
355506999351,8cyclictest3650808-21df23:45:142
355506999351,8cyclictest3650808-21df23:45:142
355506999351,7cyclictest3648086-21cat23:35:212
355506999351,4cyclictest3642366-21/usr/sbin/munin23:20:172
3555064993527,5cyclictest0-21swapper/100:30:261
3555064993521,11cyclictest231ktimers/123:40:121
3555064993521,11cyclictest231ktimers/123:40:121
3555060993528,4cyclictest3660688-21cron00:15:000
3555060993526,4cyclictest0-21swapper/023:15:000
3555073993427,3cyclictest0-21swapper/319:40:003
3555073993424,6cyclictest3667598-21cat00:35:013
3555073993424,6cyclictest3584600-21grep20:30:273
3555073993423,8cyclictest3649999-21grep23:40:253
3555073993423,8cyclictest3649999-21grep23:40:253
355506999341,7cyclictest3595837-21/usr/sbin/munin21:05:202
3555060993427,3cyclictest0-21swapper/022:30:000
3555060993426,4cyclictest0-21swapper/019:55:160
3555060993426,4cyclictest0-21swapper/019:55:160
3555073993326,4cyclictest2-21kthreadd23:35:003
3555073993326,3cyclictest0-21swapper/322:50:003
3555073993326,3cyclictest0-21swapper/322:50:003
3555073993325,5cyclictest3586243-21unixbench_multi20:35:253
3555073993325,4cyclictest0-21swapper/322:40:263
3555073993325,4cyclictest0-21swapper/322:40:253
3555073993322,7cyclictest0-21swapper/321:30:263
3555073993321,8cyclictest3557133-21apt-key19:15:023
3555064993327,4cyclictest3664130-21munin-plugin-st00:25:001
3555064993326,4cyclictest3557449-21fschecks_time19:15:031
3555064993325,4cyclictest0-21swapper/100:25:161
3555064993324,5cyclictest0-21swapper/120:00:001
3555064993324,5cyclictest0-21swapper/120:00:001
3555064993323,7cyclictest3577772-21grep20:10:241
3555064993315,11cyclictest131rcu_preempt19:30:111
3555060993323,6cyclictest0-21swapper/022:45:000
3555060993323,6cyclictest0-21swapper/022:45:000
3555060993323,6cyclictest0-21swapper/019:50:250
3555060993323,6cyclictest0-21swapper/019:50:250
3555060993322,7cyclictest3582861-21grep20:25:260
3555073993224,4cyclictest0-21swapper/300:35:243
3555073993223,6cyclictest3653390-21grep23:50:263
3555073993223,6cyclictest0-21swapper/320:45:013
3555073993221,8cyclictest1-21systemd19:31:113
355506499329,7cyclictest0-21swapper/123:45:121
355506499329,7cyclictest0-21swapper/123:45:121
355506499326,6cyclictest24-21ksoftirqd/100:35:231
3555060993225,4cyclictest3607409-21munin-plugin-st21:40:000
3555060993225,4cyclictest0-21swapper/022:15:260
3555060993225,4cyclictest0-21swapper/019:45:280
3555060993225,4cyclictest0-21swapper/019:45:280
3555060993225,4cyclictest0-21swapper/019:40:000
3555073993123,4cyclictest0-21swapper/320:25:263
3555073993123,4cyclictest0-21swapper/320:15:263
355506499318,4cyclictest3657931-21latency00:05:201
3555064993123,4cyclictest0-21swapper/122:16:361
3555064993123,4cyclictest0-21swapper/121:50:231
3555064993121,6cyclictest3641708-21cron23:20:001
3555064993116,4cyclictest0-21swapper/121:10:181
3555060993124,4cyclictest0-21swapper/022:31:380
3555060993124,3cyclictest0-21swapper/019:20:250
3555060993122,6cyclictest3643015-21unixbench_singl23:20:250
3555060993121,6cyclictest3664116-21sh00:25:000
3555060993121,6cyclictest0-21swapper/020:20:150
3555060993121,6cyclictest0-21swapper/019:40:250
3555060993119,9cyclictest438-21cron21:50:000
3555060993119,7cyclictest0-21swapper/022:20:280
3555073993024,4cyclictest3605581-21kworker/u8:0+events_unbound21:36:313
3555073993023,5cyclictest3643144-21kworker/u8:2+events_unbound23:21:453
3555073993023,3cyclictest0-21swapper/323:45:263
3555073993023,3cyclictest0-21swapper/323:45:263
3555073993022,4cyclictest0-21swapper/323:10:263
3555073993022,4cyclictest0-21swapper/321:05:013
3555073993021,6cyclictest3644888-21grep23:25:253
3555073993020,6cyclictest0-21swapper/300:30:003
3555073993019,7cyclictest3617174-21grep22:05:263
355506499305,6cyclictest24-21ksoftirqd/123:10:191
355506499305,6cyclictest24-21ksoftirqd/120:05:131
355506499304,7cyclictest24-21ksoftirqd/120:35:161
3555064993022,4cyclictest0-21swapper/122:06:341
3555064993022,4cyclictest0-21swapper/121:35:291
3555064993022,4cyclictest0-21swapper/120:56:251
3555064993020,6cyclictest0-21swapper/123:40:001
3555064993018,7cyclictest0-21swapper/100:10:261
3555060993022,4cyclictest0-21swapper/019:15:040
3555060993021,6cyclictest0-21swapper/020:10:240
3555073992920,5cyclictest0-21swapper/319:45:183
3555073992920,5cyclictest0-21swapper/319:45:183
355506499296,7cyclictest24-21ksoftirqd/123:25:141
3555064992921,4cyclictest0-21swapper/122:20:191
3555064992920,5cyclictest3629578-21sh22:45:001
3555064992920,5cyclictest3629578-21sh22:45:001
3555064992919,6cyclictest0-21swapper/122:30:001
3555064992915,4cyclictest131rcu_preempt20:31:431
3555060992923,3cyclictest0-21swapper/023:00:010
3555060992922,4cyclictest0-21swapper/020:00:260
3555060992921,4cyclictest0-21swapper/022:10:250
3555060992920,6cyclictest3637879-21unixbench_singl23:05:230
3555060992920,5cyclictest0-21swapper/021:40:240
3555060992919,6cyclictest0-21swapper/021:55:240
3555073992821,3cyclictest0-21swapper/321:10:273
3555073992820,4cyclictest0-21swapper/300:10:173
3555073992820,3cyclictest0-21swapper/320:00:003
3555073992820,3cyclictest0-21swapper/320:00:003
355506499286,6cyclictest24-21ksoftirqd/123:05:011
355506499284,8cyclictest24-21ksoftirqd/122:30:171
3555064992822,4cyclictest231ktimers/120:26:001
3555064992821,4cyclictest3634901-21kthreadd23:00:011
3555064992819,7cyclictest231ktimers/121:25:121
3555064992819,6cyclictest3555054-21cyclictest21:40:241
3555064992817,7cyclictest0-21swapper/100:15:171
3555064992811,3cyclictest131rcu_preempt00:03:331
3555060992818,6cyclictest0-21swapper/000:00:250
3555073992719,4cyclictest0-21swapper/320:55:173
3555073992717,6cyclictest3567497-21grep19:40:253
3555073992717,6cyclictest0-21swapper/319:25:253
3555073992716,8cyclictest3626167-21ls22:35:003
355506499277,6cyclictest24-21ksoftirqd/119:20:241
355506499276,7cyclictest24-21ksoftirqd/122:45:271
355506499276,7cyclictest24-21ksoftirqd/122:45:271
355506499276,5cyclictest24-21ksoftirqd/121:30:461
355506499276,3cyclictest0-21swapper/123:30:141
355506499274,15cyclictest24-21ksoftirqd/120:50:201
355506499273,8cyclictest24-21ksoftirqd/123:10:011
355506499273,8cyclictest24-21ksoftirqd/121:23:461
355506499272,8cyclictest24-21ksoftirqd/119:41:281
3555064992720,5cyclictest231ktimers/120:00:191
355506499271,8cyclictest24-21ksoftirqd/119:45:161
355506499271,8cyclictest24-21ksoftirqd/119:45:161
3555064992718,6cyclictest0-21swapper/122:00:001
3555064992716,4cyclictest131rcu_preempt21:00:261
3555060992718,6cyclictest3586241-21grep20:35:250
3555060992718,6cyclictest0-21swapper/023:20:000
3555060992718,5cyclictest0-21swapper/020:50:010
3555073992618,4cyclictest0-21swapper/321:55:243
3555073992617,6cyclictest0-21swapper/323:20:003
355506499263,5cyclictest24-21ksoftirqd/119:35:021
355506499261,9cyclictest24-21ksoftirqd/121:10:001
3555064992619,4cyclictest0-21swapper/119:50:251
3555064992619,4cyclictest0-21swapper/119:50:251
3555064992614,4cyclictest131rcu_preempt19:25:191
3555060992619,5cyclictest3633089-21kworker/u8:0+events_unbound23:26:450
3555060992617,6cyclictest0-21swapper/021:20:000
3555060992617,5cyclictest0-21swapper/022:00:180
3555060992617,5cyclictest0-21swapper/020:55:210
3555073992518,3cyclictest0-21swapper/323:55:233
3555073992517,6cyclictest391ktimers/321:20:033
3555073992516,6cyclictest0-21swapper/322:40:003
3555073992515,6cyclictest0-21swapper/323:00:263
355506499259,4cyclictest131rcu_preempt22:00:121
355506499254,7cyclictest0-21swapper/123:23:231
3555064992511,8cyclictest0-21swapper/123:52:081
3555060992520,3cyclictest13550irq/42-30be0000.ethernet21:50:160
3555060992518,4cyclictest0-21swapper/020:15:260
3555060992516,5cyclictest0-21swapper/022:45:280
3555060992516,5cyclictest0-21swapper/022:45:280
3555060992515,6cyclictest0-21swapper/021:30:250
3555073992418,4cyclictest3618866-21grep22:10:253
3555073992418,3cyclictest3570432-21ntpq19:50:203
3555073992418,3cyclictest3570432-21ntpq19:50:203
3555073992418,3cyclictest0-21swapper/320:10:243
3555073992417,3cyclictest0-21swapper/322:20:003
3555073992415,5cyclictest0-21swapper/322:00:163
355506499245,5cyclictest24-21ksoftirqd/120:45:191
355506499243,6cyclictest0-21swapper/123:59:171
3555060992417,3cyclictest0-21swapper/023:37:590
3555060992417,3cyclictest0-21swapper/021:26:080
3555060992416,5cyclictest0-21swapper/021:20:140
3555060992416,5cyclictest0-21swapper/021:00:260
355506099241,19cyclictest0-21swapper/023:43:380
355506099241,19cyclictest0-21swapper/023:43:380
355506099241,19cyclictest0-21swapper/022:06:090
3555073992317,4cyclictest3610817-21kthreadd21:50:003
3555073992317,3cyclictest0-21swapper/320:05:193
3555073992315,5cyclictest0-21swapper/322:25:263
3555073992314,6cyclictest0-21swapper/321:40:193
3555073992313,6cyclictest0-21swapper/320:20:253
355506499231,5cyclictest3587063-21df20:40:141
3555060992316,3cyclictest0-21swapper/022:50:160
3555060992316,3cyclictest0-21swapper/021:10:220
3555060992314,6cyclictest3590774-21ls20:50:190
3555073992216,3cyclictest0-21swapper/321:05:223
3555073992215,4cyclictest0-21swapper/320:50:253
3555073992215,3cyclictest0-21swapper/300:00:203
355506099222,16cyclictest629-21snmpd00:05:180
3555060992214,5cyclictest0-21swapper/023:45:220
3555060992214,5cyclictest0-21swapper/023:45:210
355506099221,17cyclictest0-21swapper/020:41:230
355507399211,13cyclictest3600359-21apt-get21:20:003
3555073992014,3cyclictest0-21swapper/323:05:163
3555073992014,3cyclictest0-21swapper/321:51:333
355507399192,13cyclictest3590122-21cron20:50:013
3555073991912,4cyclictest3647276-21/usr/sbin/munin23:35:163
3555073991810,5cyclictest0-21swapper/320:00:243
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional