You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-18 - 22:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot8s.osadl.org (updated Wed Mar 18, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
29081099913250,1321cyclictest31039152sleep321:39:573
29081099912710,1267cyclictest29855662sleep320:10:013
29081099912290,1225cyclictest32271842sleep323:04:563
29081099911251,1120cyclictest33505802sleep300:29:553
72699270,10ntpd3234760-21ssh23:10:122
72699260,16ntpd3285937-21apt23:45:120
72699240,2ntpd0-21swapper/020:05:210
72699230,8ntpd3167404-21ntpq22:20:190
72699230,8ntpd3028319-21python320:40:222
72699230,8ntpd0-21swapper/000:00:220
72699230,6ntpd3232604-21ntpq23:05:190
72699230,6ntpd3118929-21apt-get21:50:120
72699230,6ntpd2991846-21apt-get20:15:130
72699220,6ntpd3220301-21apt-get23:00:130
72699220,6ntpd3138471-21ntpq22:00:221
72699220,6ntpd3124102-21ntpq21:50:222
72699220,6ntpd3028046-21ntpq20:40:181
72699220,6ntpd3016535-21munin-run20:35:010
72699220,6ntpd3016535-21munin-run20:35:000
72699220,6ntpd2921741-21ntpq19:15:211
72699220,5ntpd2985612-21apt-get20:10:121
72699220,2ntpd0-21swapper/020:50:210
72699210,7ntpd3219977-21cron23:00:011
72699210,7ntpd3116760-21ntpq21:45:202
72699210,7ntpd2929302-21df_inode19:25:130
72699210,6ntpd3351093-21df00:30:152
72699210,6ntpd3162328-21apt-get22:20:101
72699210,6ntpd3052867-21memory21:00:192
72699210,6ntpd3046855-21ntpq20:55:230
72699210,5ntpd3320028-21ntpq00:05:222
72699210,5ntpd3278570-21df23:40:130
72699210,5ntpd3271131-21apt-get23:35:120
72699210,5ntpd3254460-21ntpq23:20:230
72699210,5ntpd3191429-21df_inode22:40:130
72699210,5ntpd3176760-21apt-get22:30:140
72699210,5ntpd3075074-21apt-get21:20:121
72699210,5ntpd2954395-21apt-get19:45:111
72699200,9ntpd2895324-21kworker/u16:3+nfsiod21:17:401
72699200,8ntpd3285281-21kworker/u16:2+xprtiod00:11:501
72699200,8ntpd2971746-21needreboot19:55:182
72699200,7ntpd3335518-21ssh00:17:322
72699200,7ntpd3175605-21ssh22:26:511
72699200,6ntpd3358093-21ssh00:35:082
72699200,6ntpd3152999-21ld22:10:221
72699200,6ntpd3060237-21diskmemload22:38:452
72699200,6ntpd2960786-21grep19:50:141
72699200,5ntpd3358308-21diskstats00:35:141
72699200,5ntpd3343712-21apt-get00:25:112
72699200,5ntpd3341632-21ntpq00:20:221
72699200,5ntpd3293176-21apt-get23:50:101
72699200,5ntpd3290886-21memory23:45:192
72699200,5ntpd3212761-21munin-run22:55:002
72699200,5ntpd3198578-21apt-get22:45:121
72699200,5ntpd3162056-21munin-run22:20:012
72699200,5ntpd3160192-21ntpq22:15:201
72699200,5ntpd3131295-21ntpq21:55:200
72699200,5ntpd3089939-21diskstats21:30:130
72699200,5ntpd3089770-21apt-get21:30:121
72699200,5ntpd3082445-21df_inode21:25:110
72699200,5ntpd3060237-21diskmemload22:09:582
72699200,5ntpd3060237-21diskmemload00:02:022
72699200,5ntpd3059356-21ntpq21:05:220
72699200,4ntpd72-21kcompactd021:55:322
72699200,4ntpd3263693-21ssh23:30:121
72699200,4ntpd3205809-21apt22:50:100
72699200,4ntpd2996822-21ntpq20:15:211
72699200,3ntpd3082291-21ssh21:25:101
72699200,2ntpd0-21swapper/021:00:220
72699200,10ntpd3111486-21kworker/0:0+kacpid22:36:460
290810999208,8cyclictest32763062sleep323:35:233
72699190,6ntpd3185687-21kthreadcore22:35:151
72699190,6ntpd3032677-21kthreadcore20:45:161
72699190,6ntpd2969115-21tr19:55:160
72699190,6ntpd2965693-21ntpq19:50:222
72699190,6ntpd0-21swapper/219:45:202
72699190,5ntpd3348840-21ntpq00:25:221
72699190,5ntpd3329461-21diskstats00:15:130
72699190,5ntpd3319773-21memory00:05:191
72699190,5ntpd3256634-21diskstats23:25:130
72699190,5ntpd3168378-21ssh22:21:552
72699190,5ntpd3160137-21ntpq22:15:190
72699190,5ntpd3140431-21grep22:05:000
72699190,5ntpd3117041-21python321:45:230
72699190,5ntpd3072905-21ntpq21:15:182
72699190,5ntpd3065917-21python321:10:240
72699190,5ntpd3060237-21diskmemload21:56:431
72699190,5ntpd2936986-21irqstats19:30:152
72699190,5ntpd2927995-21ntp_states19:20:211
72699190,5ntpd2913610-21python319:10:230
72699190,4ntpd3329587-21hddtemp_smartct00:15:141
72699190,4ntpd3262410-21sh23:26:271
72699190,4ntpd3256102-21ssh23:24:452
72699190,4ntpd3242009-21apt-get23:15:130
72699190,4ntpd3232655-21ntpq23:05:202
72699190,4ntpd3196495-21ntpq22:40:221
72699190,4ntpd3060237-21diskmemload22:03:342
72699190,4ntpd3060237-21diskmemload00:39:030
72699190,4ntpd3035511-21apt-get20:50:121
72699190,4ntpd3023085-21apt-get20:40:100
72699190,4ntpd2979354-21apt-get20:05:121
72699190,4ntpd2927936-21ntpq19:20:202
72699190,4ntpd2913446-21ntpq19:10:202
72699190,3ntpd3060237-21diskmemload22:56:420
72699190,2ntpd3341676-21ssh00:20:232
72699190,2ntpd0-21swapper/221:21:232
2908109991912,3cyclictest3300162-21turbostat23:55:013
290810999191,14cyclictest3190939-21turbostat22:40:003
2908109991910,6cyclictest2947885-21sleep19:39:593
72699180,5ntpd3314089-21ssh00:03:141
72699180,5ntpd3284178-21ssh23:40:391
72699180,5ntpd3067957-21df_inode21:15:100
72699180,5ntpd2999426-21irqstats20:20:152
72699180,5ntpd2921635-21/usr/sbin/munin19:15:190
72699180,5ntpd2903914-21kthreadcore19:05:172
72699180,4ntpd3340552-21grep00:20:180
72699180,4ntpd3303491-21tr23:55:171
72699180,4ntpd3293475-21smartctl23:50:142
72699180,4ntpd3236114-21ssh23:10:161
72699180,4ntpd3210999-21ntpq22:50:191
72699180,4ntpd3175825-21ssh22:27:432
72699180,4ntpd3140783-21expr22:05:151
72699180,4ntpd3118489-21ssh21:49:341
72699180,4ntpd3109477-21grep21:40:181
72699180,4ntpd3021682-21cat20:35:191
72699180,4ntpd2974474-21kthreadcore20:00:170
72699180,4ntpd2954207-21sed19:45:000
72699180,4ntpd2947005-21ntp_states19:35:222
72699180,3ntpd3285861-21ssh23:45:021
72699180,3ntpd3182114-21switchtime22:30:261
72699180,3ntpd3065738-21ssh21:10:212
72699180,3ntpd3060237-21diskmemload00:31:371
72699180,2ntpd0-21swapper/220:55:202
72699180,2ntpd0-21swapper/000:14:170
290810999185,10cyclictest3263217-21taskset23:29:293
290810999181,14cyclictest3307340-21sleep00:04:553
2908109991810,5cyclictest3256178-21sleep23:25:003
72699170,5ntpd3205020-21ssh22:48:132
72699170,4ntpd3263650-21ssh23:30:110
72699170,4ntpd3247148-21ld23:15:212
72699170,4ntpd3226181-21ssh23:01:122
72699170,4ntpd3197751-21ssh22:43:102
72699170,4ntpd3182495-21ssh22:30:402
72699170,4ntpd3154498-21ssh22:14:042
72699170,4ntpd3144878-21tr22:05:200
72699170,4ntpd3110448-21ssh21:41:172
72699170,4ntpd3101097-21kthreadcore21:35:170
72699170,4ntpd3098379-21ssh21:35:162
72699170,4ntpd3082238-21ssh21:25:062
72699170,4ntpd2953269-21ld19:40:212
72699170,4ntpd2944538-21tr19:35:171
72699170,4ntpd2940478-21sed19:30:161
72699170,4ntpd2925822-21kthreadcore19:20:170
72699170,4ntpd2910119-21tr19:10:151
72699170,3ntpd3327261-21ntpq00:10:222
72699170,3ntpd3125520-21ssh21:53:501
72699170,3ntpd3022093-21smartctl20:35:240
72699170,3ntpd3007602-21kthreadcore20:25:180
72699170,3ntpd2935111-21latency_hist19:30:001
72699170,3ntpd0-21swapper/220:15:222
72699170,2ntpd0-21swapper/121:35:211
72699170,1ntpd3003141-21ntpq20:20:210
30218322172,5sleep23021876-21ntpq20:35:222
290810999173,9cyclictest32859042sleep323:45:123
290810999173,11cyclictest2966367-21chrt19:52:543
2908109991711,3cyclictest30342942sleep320:45:203
290810999171,12cyclictest3010579-21taskset20:30:133
290810999171,12cyclictest3010579-21taskset20:30:123
290810999171,12cyclictest2998084-21taskset20:20:103
290810999171,11cyclictest3133071-21turbostat21:59:593
72699160,6ntpd2908101-21cyclictest20:28:432
72699160,4ntpd3277584-21ssh23:38:081
72699160,4ntpd3271745-21irqcore23:35:162
72699160,4ntpd2967854-21cut19:55:151
72699160,3ntpd3321033-21sshd00:07:120
72699160,3ntpd3285281-21kworker/u16:2-nfsiod23:57:282
72699160,3ntpd3285195-21diskmemload23:44:282
72699160,3ntpd3269407-21ssh23:30:412
72699160,3ntpd3257119-21irqcore23:25:152
72699160,3ntpd3233688-21ssh23:07:121
72699160,3ntpd3198949-21ssh22:45:150
72699160,3ntpd3173508-21kthreadcore22:25:170
72699160,3ntpd3108737-21kthreadcore21:40:170
72699160,3ntpd3057152-21grep21:05:182
72699160,3ntpd2906057-21cut19:05:180
72699160,2ntpd3348809-21ssh00:25:210
72699160,2ntpd3249526-21ssh23:20:151
72699160,2ntpd3060237-21diskmemload21:20:060
72699160,2ntpd0-21swapper/222:55:212
72699160,2ntpd0-21swapper/219:25:212
72699160,2ntpd0-21swapper/121:10:201
72699160,2ntpd0-21swapper/119:05:211
72699160,2ntpd0-21swapper/019:45:180
72699160,2ntpd0-21swapper/000:30:240
290810999169,4cyclictest3047724-21turbostat21:00:003
290810999168,5cyclictest2941652-21turbostat19:35:003
290810999166,7cyclictest3232667-21taskset23:05:203
290810999166,7cyclictest2960033-21taskset19:46:383
290810999165,8cyclictest3060158-21chrt21:09:083
290810999164,9cyclictest3053894-21taskset21:04:023
290810999162,10cyclictest2916657-21taskset19:15:123
2908109991613,1cyclictest0-21swapper/322:40:213
2908109991613,1cyclictest0-21swapper/321:10:233
2908109991613,1cyclictest0-21swapper/319:40:333
2908109991612,1cyclictest0-21swapper/322:50:183
2908109991612,1cyclictest0-21swapper/322:20:093
290810999161,12cyclictest3285330-21chrt23:44:563
72699150,4ntpd2908101-21cyclictest23:15:051
72699150,3ntpd3306386-21sshd23:56:340
72699150,3ntpd2938507-21kthreadcore19:30:150
72699150,2ntpd0-21swapper/221:30:212
72699150,2ntpd0-21swapper/220:50:222
72699150,2ntpd0-21swapper/220:45:112
72699150,2ntpd0-21swapper/220:10:212
72699150,2ntpd0-21swapper/220:05:192
72699150,2ntpd0-21swapper/123:00:231
72699150,2ntpd0-21swapper/121:00:161
72699150,2ntpd0-21swapper/120:30:221
72699150,2ntpd0-21swapper/120:30:211
72699150,2ntpd0-21swapper/120:20:191
72699150,2ntpd0-21swapper/023:10:190
72699150,2ntpd0-21swapper/020:45:200
72699150,2ntpd0-21swapper/020:10:130
72699150,2ntpd0-21swapper/019:50:200
72699150,1ntpd0-21swapper/120:55:131
72699150,1ntpd0-21swapper/019:35:120
290810999157,6cyclictest2967171-21chrt19:55:143
290810999156,7cyclictest2997640-21taskset20:18:193
290810999155,8cyclictest3041525-21taskset20:55:013
290810999155,7cyclictest3104495-21taskset21:40:083
2908109991512,1cyclictest0-21swapper/323:57:003
2908109991512,1cyclictest0-21swapper/323:35:003
2908109991512,1cyclictest0-21swapper/322:55:163
2908109991512,1cyclictest0-21swapper/322:45:173
2908109991512,1cyclictest0-21swapper/322:30:133
2908109991512,1cyclictest0-21swapper/322:18:033
2908109991512,1cyclictest0-21swapper/321:50:183
2908109991512,1cyclictest0-21swapper/321:30:123
2908109991512,1cyclictest0-21swapper/321:20:243
2908109991512,1cyclictest0-21swapper/320:40:123
2908109991512,1cyclictest0-21swapper/320:40:013
2908109991512,1cyclictest0-21swapper/319:25:233
2908109991512,1cyclictest0-21swapper/319:21:073
2908109991512,1cyclictest0-21swapper/319:10:243
2908109991512,1cyclictest0-21swapper/300:35:123
2908109991512,1cyclictest0-21swapper/300:20:133
2908109991512,1cyclictest0-21swapper/300:10:093
2908109991512,1cyclictest0-21swapper/300:05:123
2908109991511,1cyclictest0-21swapper/322:05:133
290810999150,11cyclictest2979084-21turbostat20:05:013
290810999150,10cyclictest31333512sleep322:00:143
72699140,2ntpd0-21swapper/120:25:211
72699140,2ntpd0-21swapper/023:51:270
72699140,1ntpd0-21swapper/219:15:202
72699140,1ntpd0-21swapper/121:05:131
72699140,1ntpd0-21swapper/120:00:131
72699140,1ntpd0-21swapper/119:40:191
72699140,1ntpd0-21swapper/022:11:550
290810999144,7cyclictest3004280-21taskset20:25:083
2908109991411,1cyclictest0-21swapper/323:10:133
2908109991411,1cyclictest0-21swapper/322:25:143
2908109991411,1cyclictest0-21swapper/322:10:153
2908109991411,1cyclictest0-21swapper/321:45:213
2908109991411,1cyclictest0-21swapper/321:25:183
2908109991411,1cyclictest0-21swapper/321:15:093
2908109991411,1cyclictest0-21swapper/320:05:163
2908109991411,1cyclictest0-21swapper/300:30:143
2908109991411,1cyclictest0-21swapper/300:15:123
290810999140,11cyclictest3241932-21taskset23:15:023
72699130,2ntpd0-21swapper/220:00:182
2908109991311,1cyclictest0-21swapper/319:10:023
72699120,1ntpd0-21swapper/220:32:512
72699120,1ntpd0-21swapper/220:32:502
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional