You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-17 - 22:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8s.osadl.org (updated Tue Mar 17, 2026 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
34456069912210,1217cyclictest35539122sleep308:34:563
34456069912160,1213cyclictest37065492sleep310:24:563
34456069911771,1171cyclictest3641056-21sleep09:40:013
3445606998680,863cyclictest3830488-21sleep11:50:003
72699250,8ntpd3546819-21ntp_states08:25:222
72699240,6ntpd3886937-21ntpq12:25:220
72699230,8ntpd3881419-21base6412:24:591
72699230,8ntpd3668333-21python309:55:242
72699230,6ntpd3692372-21apt-get10:15:120
72699220,8ntpd3459022-21/usr/sbin/munin07:15:180
72699220,7ntpd3814466-21users11:35:240
72699220,6ntpd3736038-21apt-get10:45:111
72699220,6ntpd3728834-21apt-get10:40:110
72699220,6ntpd3641358-21apt-get09:40:120
72699220,6ntpd3597643-21diskmemload09:51:351
72699220,6ntpd3515367-21ntp_states08:00:212
72699220,5ntpd3866992-21apt-get12:15:110
72699220,5ntpd3845297-21apt-get12:00:121
72699220,5ntpd3813974-21ssh11:35:211
72699220,2ntpd0-21swapper/009:55:220
72699220,10ntpd3705353-21kworker/u16:2+xprtiod10:44:161
72699210,7ntpd91-21kswapd011:15:231
72699210,7ntpd3903155-21sed12:39:590
72699210,7ntpd3764193-21ssh11:02:201
72699210,7ntpd3681567-21cut10:05:172
72699210,7ntpd3655810-21/usr/sbin/munin09:50:120
72699210,7ntpd3611338-21ssh09:17:032
72699210,6ntpd3712065-21ntpq10:25:222
72699210,6ntpd3597643-21diskmemload10:30:152
72699210,6ntpd3597643-21diskmemload09:24:260
72699210,6ntpd3578033-21ntpq08:50:180
72699210,6ntpd3565570-21ntpq08:40:212
72699210,5ntpd3872170-21ntp_states12:15:212
72699210,5ntpd3845590-21hddtemp_smartct12:00:140
72699210,5ntpd3756104-21python310:55:240
72699210,5ntpd3756104-21python310:55:240
72699210,5ntpd3690036-21ntp_states10:10:200
72699210,5ntpd3670495-21apt-get10:00:101
72699210,5ntpd3604513-21updatedb.plocat09:13:340
72699210,5ntpd3597643-21diskmemload10:29:540
72699210,5ntpd3584283-21ntpq08:55:232
72699210,5ntpd3566721-21apt-get08:45:121
72699210,5ntpd3554204-21apt-get08:35:110
72699210,5ntpd3490654-21python307:40:231
72699210,5ntpd3484144-21ntpq07:35:201
72699210,5ntpd3477930-21ntp_states07:30:220
72699210,5ntpd3453895-21ntpq07:15:022
72699210,2ntpd3697528-21ssh10:15:211
72699200,7ntpd3895153-21sh12:32:150
72699200,7ntpd3816069-21apt-get11:40:132
72699200,7ntpd3778792-21ssh11:12:041
72699200,7ntpd3597643-21diskmemload09:43:522
72699200,7ntpd3498576-21sed07:50:140
72699200,6ntpd3597643-21diskmemload10:06:130
72699200,5ntpd3874404-21df12:20:110
72699200,5ntpd3859168-21ssh12:08:582
72699200,5ntpd3835869-21ntpq11:50:191
72699200,5ntpd3828666-21ntpq11:45:202
72699200,5ntpd3808034-21ssh11:33:152
72699200,5ntpd3704739-21ntpq10:20:181
72699200,5ntpd3699787-21diskstats10:20:100
72699200,5ntpd3591712-21apt-get09:05:121
72699200,5ntpd3555546-21irqstats08:35:151
72699200,5ntpd3541736-21apt-get08:25:131
72699200,5ntpd3523299-21hddtemp_smartct08:10:150
72699200,5ntpd3510594-21hddtemp_smartct08:00:141
72699200,5ntpd3496654-21ntpq07:45:201
72699200,5ntpd3472824-21apt-get07:30:122
72699200,5ntpd3460535-21diskstats07:20:131
72699200,5ntpd3439863-21hddtemp_smartct07:05:141
72699200,4ntpd3881747-21apt-get12:25:132
72699200,4ntpd3806697-21ssh11:30:181
72699200,4ntpd3792229-21ntpq11:20:202
72699200,3ntpd3889000-21ssh12:30:121
72699200,2ntpd0-21swapper/109:45:231
72699200,1ntpd0-21swapper/209:10:222
3445606992017,1cyclictest0-21swapper/309:15:183
3445606992017,1cyclictest0-21swapper/307:20:003
72699190,6ntpd3865923-21ssh12:12:132
72699190,6ntpd3836615-21ssh11:50:502
72699190,6ntpd3822870-21ssh11:44:431
72699190,6ntpd3794356-21apt-get11:25:131
72699190,6ntpd3740794-21grep10:45:162
72699190,6ntpd3630604-21cut09:30:170
72699190,6ntpd3625135-21sed09:25:240
72699190,6ntpd3597643-21diskmemload12:25:491
72699190,6ntpd3574155-21sed08:50:132
72699190,6ntpd3559846-21kworker/u16:1-events_unbound09:38:520
72699190,5ntpd3856284-21kthreadcore12:05:180
72699190,5ntpd3784989-21ntpq11:15:212
72699190,5ntpd3534273-21ntp_kernel_pll_08:15:210
72699190,4ntpd537-21mta-sts-daemon11:45:121
72699190,4ntpd3852550-21apt-get12:05:131
72699190,4ntpd3792913-21ssh11:20:531
72699190,4ntpd3764928-21awk11:05:000
72699190,4ntpd3748430-21ssh10:50:222
72699190,4ntpd3706893-21apt-get10:25:121
72699190,4ntpd3640172-21ssh09:36:501
72699190,4ntpd3632061-21ntpq09:30:212
72699190,4ntpd3612120-21ssh09:19:571
72699190,4ntpd3597643-21diskmemload10:07:511
72699190,4ntpd3585624-21df09:00:130
72699190,4ntpd3521621-21ntpq08:05:212
72699190,4ntpd3471606-21ntpq07:25:211
72699190,3ntpd3634104-21ssh09:35:102
72699190,3ntpd3597643-21diskmemload11:34:230
72699190,3ntpd0-21swapper/207:25:232
72699190,2ntpd3894137-21ssh12:30:232
72699190,2ntpd171rcu_preempt07:40:220
72699190,2ntpd0-21swapper/207:35:222
72699190,2ntpd0-21swapper/011:25:220
72699190,1ntpd0-21swapper/210:40:192
72699180,6ntpd3485363-21/usr/sbin/munin07:40:242
72699180,5ntpd3902473-21runrttasks12:37:452
72699180,5ntpd3788505-21kthreadcore11:20:160
72699180,5ntpd3689342-21cut10:10:161
72699180,5ntpd3619257-21ssh09:24:321
72699180,5ntpd3592076-21irqcore09:05:150
72699180,5ntpd3469487-21kthreadcore07:25:180
72699180,5ntpd3459261-21proc_pri07:15:221
72699180,4ntpd3877122-21grep12:20:152
72699180,4ntpd3844427-21ssh11:58:002
72699180,4ntpd3844303-21ssh11:57:331
72699180,4ntpd3777864-21ntp_states11:10:200
72699180,4ntpd3769577-21grep11:05:172
72699180,4ntpd3727624-21ssh10:36:452
72699180,4ntpd3597643-21diskmemload10:54:141
72699180,4ntpd3582032-21cut08:55:190
72699180,4ntpd3568564-21cut08:45:172
72699180,4ntpd3528106-21ntpq08:10:221
72699180,4ntpd3510306-21apt-get08:00:100
72699180,4ntpd3501674-21tr07:50:162
72699180,4ntpd3491791-21diskstats07:45:132
72699180,4ntpd3479462-21tail07:35:150
72699180,3ntpd3720402-21taskset10:31:510
72699180,3ntpd3714286-21ssh10:30:011
72699180,3ntpd3662157-21ssh09:53:052
72699180,3ntpd3652237-21grep09:45:190
3445606991812,4cyclictest3655452-21turbostat09:50:003
34397342180,4sleep30-21swapper/307:05:143
72699170,5ntpd3815356-21ssh11:38:432
72699170,5ntpd3647590-21ssh09:42:371
72699170,4ntpd3902666-21sshd12:38:331
72699170,4ntpd3852136-21ssh12:04:362
72699170,4ntpd3826804-21cut11:45:170
72699170,4ntpd3821242-21ssh11:40:230
72699170,4ntpd3775001-21kthreadcore11:10:152
72699170,4ntpd3759106-21sed11:00:152
72699170,4ntpd3752133-21ssh10:55:171
72699170,4ntpd3752133-21ssh10:55:171
72699170,4ntpd3698407-21ssh10:16:432
72699170,4ntpd3670646-21df10:00:110
72699170,4ntpd3669230-21ssh09:57:321
72699170,4ntpd3613218-21sed09:20:152
72699170,4ntpd3603094-21ssh09:10:211
72699170,4ntpd3597643-21diskmemload10:38:290
72699170,4ntpd3531753-21grep08:15:172
72699170,4ntpd3526746-21cut08:10:182
72699170,4ntpd3522553-21awk08:10:001
72699170,3ntpd3863242-21kthreadcore12:10:170
72699170,3ntpd3859718-21ssh12:10:041
72699170,3ntpd3830775-21apt-get11:50:110
72699170,3ntpd3756976-21ssh10:57:302
72699170,3ntpd3756976-21ssh10:57:302
72699170,3ntpd3726881-21ssh10:35:221
72699170,3ntpd3675632-21ssh10:00:192
72699170,3ntpd3626203-21ssh09:28:331
72699170,3ntpd3566809-21tr08:45:130
72699170,2ntpd3653602-21ssh09:45:212
344560699176,7cyclictest37722692sleep311:09:333
344560699171,13cyclictest3491633-21taskset07:45:123
344560699171,12cyclictest3887519-21taskset12:25:383
72699160,4ntpd3625450-21ssh09:25:432
72699160,4ntpd3553165-21mailstats08:30:232
72699160,4ntpd3461949-21cat07:20:162
72699160,3ntpd3771305-21ssh11:05:551
72699160,3ntpd3741081-21strings10:45:180
72699160,3ntpd3689980-21ssh10:10:192
72699160,3ntpd3553298-21find08:30:241
72699160,3ntpd3540426-21needreboot08:20:181
72699160,3ntpd3492396-21irqcore07:45:150
72699160,3ntpd3448987-21tr07:10:182
72699160,3ntpd0-21swapper/107:55:211
72699160,2ntpd171rcu_preempt12:15:201
72699160,2ntpd0-21swapper/210:24:082
72699160,2ntpd0-21swapper/009:15:200
72699160,2ntpd0-21swapper/007:05:200
344560699165,8cyclictest3570017-21taskset08:45:183
3445606991613,1cyclictest0-21swapper/310:00:193
3445606991613,1cyclictest0-21swapper/309:44:503
3445606991613,1cyclictest0-21swapper/309:05:203
344560699161,12cyclictest3779601-21turbostat11:15:003
344560699161,12cyclictest3728839-21chrt10:40:113
344560699161,12cyclictest3669919-21turbostat10:00:003
344560699161,11cyclictest3585481-21taskset09:00:123
72699150,3ntpd3744004-21irqcore10:50:150
72699150,2ntpd3799349-21strings11:25:202
72699150,2ntpd0-21swapper/209:05:212
72699150,2ntpd0-21swapper/209:00:222
72699150,2ntpd0-21swapper/208:20:202
72699150,2ntpd0-21swapper/207:55:192
72699150,2ntpd0-21swapper/109:31:041
72699150,2ntpd0-21swapper/109:00:201
72699150,2ntpd0-21swapper/107:50:211
72699150,2ntpd0-21swapper/107:30:211
72699150,2ntpd0-21swapper/107:10:221
72699150,2ntpd0-21swapper/011:05:190
72699150,2ntpd0-21swapper/007:55:200
72699150,2ntpd0-21swapper/007:20:200
38587342151,1sleep30-21swapper/312:07:203
36836842151,10sleep30-21swapper/310:06:383
344560699155,7cyclictest38389532sleep311:55:173
344560699155,7cyclictest37422362sleep310:47:213
344560699155,7cyclictest37134312sleep310:28:463
344560699151,9cyclictest35229832sleep308:10:123
3445606991513,1cyclictest0-21swapper/311:35:273
3445606991512,1cyclictest0-21swapper/312:21:343
3445606991512,1cyclictest0-21swapper/311:02:563
3445606991512,1cyclictest0-21swapper/310:52:253
3445606991512,1cyclictest0-21swapper/310:30:223
3445606991512,1cyclictest0-21swapper/310:12:213
344560699151,11cyclictest3845220-21taskset12:00:013
344560699151,11cyclictest3619408-21turbostat09:25:003
344560699151,11cyclictest3564152-21taskset08:40:173
344560699151,10cyclictest3860228-21taskset12:10:153
344560699151,10cyclictest3750922-21taskset10:55:133
344560699151,10cyclictest3750922-21taskset10:55:133
344560699150,6cyclictest0-21swapper/307:20:173
72699140,4ntpd3445153-21taskset07:06:032
72699140,2ntpd0-21swapper/208:35:162
72699140,2ntpd0-21swapper/108:40:201
72699140,2ntpd0-21swapper/011:55:220
72699140,2ntpd0-21swapper/008:05:200
72699140,1ntpd0-21swapper/008:25:230
344560699144,7cyclictest36040602sleep309:11:513
344560699144,7cyclictest3491288-21taskset07:44:203
344560699143,7cyclictest35178622sleep308:05:163
344560699142,9cyclictest0-21swapper/308:30:003
344560699141,9cyclictest3830780-21taskset11:50:113
344560699141,9cyclictest3625343-21taskset09:25:253
3445606991412,1cyclictest0-21swapper/311:24:193
3445606991412,1cyclictest0-21swapper/307:59:443
3445606991411,1cyclictest0-21swapper/310:16:143
3445606991411,1cyclictest0-21swapper/308:50:133
3445606991411,1cyclictest0-21swapper/308:35:103
3445606991411,1cyclictest0-21swapper/307:35:123
3445606991411,1cyclictest0-21swapper/307:31:573
344560699141,10cyclictest3895155-21taskset12:32:153
344560699141,10cyclictest38726072sleep312:15:253
344560699141,10cyclictest3821758-21taskset11:40:303
344560699141,10cyclictest3807874-21taskset11:32:403
344560699141,10cyclictest3584840-21taskset08:55:483
344560699141,10cyclictest3516176-21taskset08:04:193
344560699141,10cyclictest3497816-21taskset07:50:013
344560699141,10cyclictest3472213-21taskset07:25:533
344560699141,10cyclictest3450884-21chrt07:10:223
344560699140,11cyclictest3779830-21taskset11:15:013
344560699140,11cyclictest3655682-21taskset09:50:023
344560699140,10cyclictest3799504-21taskset11:25:233
72699130,2ntpd3780548-21ssh11:15:160
72699130,2ntpd0-21swapper/108:50:141
72699130,2ntpd0-21swapper/108:15:141
72699130,2ntpd0-21swapper/008:30:170
72699130,2ntpd0-21swapper/008:20:030
72699130,1ntpd0-21swapper/108:55:211
72699130,1ntpd0-21swapper/008:40:130
344560699131,9cyclictest3727593-21taskset10:36:383
3445606991312,0cyclictest0-21swapper/308:15:203
344560699131,10cyclictest3633505-21taskset09:33:553
3445606991310,1cyclictest0-21swapper/308:20:233
344560699130,10cyclictest3897620-21taskset12:35:163
72699120,1ntpd0-21swapper/007:10:030
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional