You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-26 - 00:05

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot8s.osadl.org (updated Thu Dec 25, 2025 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
33713279912120,1208cyclictest36763602sleep311:05:023
33713279911050,1101cyclictest35735172sleep309:44:553
33713279910521,1046cyclictest3541179-21sleep09:20:003
3371327999511,946cyclictest3747471-21sleep11:59:593
35346002200,1sleep20-21swapper/209:13:222
337132799198,8cyclictest3599168-21turbostat10:05:013
35156622182,6sleep13515695-21apt-get09:00:111
33809532180,8sleep03381916-21grep07:15:160
3371327991815,1cyclictest0-21swapper/309:29:593
3371327991812,3cyclictest3753920-21sleep12:05:003
301798180,8rtkit-daemon448-21wpa_supplicant07:45:122
337132799177,7cyclictest3496142-21turbostat08:45:013
337132799171,6cyclictest0-21swapper/308:55:133
3371327991714,1cyclictest0-21swapper/310:55:253
3371327991714,1cyclictest0-21swapper/307:55:013
35478572161,5sleep23547890-21apt-get09:25:122
3371327991613,1cyclictest0-21swapper/312:26:353
3371327991613,1cyclictest0-21swapper/311:20:003
3371327991613,1cyclictest0-21swapper/311:05:003
3371327991613,1cyclictest0-21swapper/310:35:003
3371327991613,1cyclictest0-21swapper/309:50:163
3371327991613,1cyclictest0-21swapper/308:29:553
3371327991613,1cyclictest0-21swapper/308:10:173
3371327991611,2cyclictest3663347-21sleep10:55:003
37283932151,1sleep30-21swapper/311:45:023
33929222150,5sleep13392955-21apt-get07:25:121
3371327991513,1cyclictest0-21swapper/312:16:253
3371327991513,1cyclictest0-21swapper/309:30:013
3371327991513,0cyclictest0-21swapper/309:56:453
3371327991513,0cyclictest0-21swapper/307:56:393
3371327991512,1cyclictest0-21swapper/312:35:173
3371327991512,1cyclictest0-21swapper/312:24:543
3371327991512,1cyclictest0-21swapper/310:35:203
3371327991512,1cyclictest0-21swapper/310:09:423
3371327991512,1cyclictest0-21swapper/307:25:013
337132799151,11cyclictest3425195-21chrt07:50:003
337132799145,7cyclictest3489704-21turbostat08:40:003
337132799144,6cyclictest36265152sleep310:25:163
3371327991413,0cyclictest0-21swapper/310:19:513
3371327991412,1cyclictest0-21swapper/311:28:023
3371327991412,1cyclictest0-21swapper/309:06:093
3371327991412,1cyclictest0-21swapper/308:52:583
3371327991412,1cyclictest0-21swapper/307:30:003
3371327991412,1cyclictest0-21swapper/307:10:213
337132799141,11cyclictest3763781-21chrt12:10:163
3371327991411,1cyclictest0-21swapper/312:05:193
3371327991411,1cyclictest0-21swapper/309:38:223
337132799141,10cyclictest3385667-21chrt07:15:223
34618152130,2sleep0221rcuc/008:15:170
337132799131,9cyclictest3734853-21taskset11:50:053
337132799131,9cyclictest3715783-21taskset11:35:153
337132799131,9cyclictest3619642-21taskset10:20:173
337132799131,9cyclictest3611628-21taskset10:10:443
337132799131,9cyclictest3575380-21taskset09:45:153
337132799131,9cyclictest3547267-21chrt09:20:403
337132799131,9cyclictest3482965-21chrt08:30:443
3371327991312,0cyclictest0-21swapper/311:41:333
3371327991312,0cyclictest0-21swapper/309:03:253
3371327991311,1cyclictest0-21swapper/309:15:023
3371327991311,1cyclictest0-21swapper/308:22:313
3371327991311,1cyclictest0-21swapper/308:05:013
3371327991311,1cyclictest0-21swapper/307:38:363
3371327991310,1cyclictest0-21swapper/311:30:473
3371327991310,1cyclictest0-21swapper/308:15:133
37155132121,8sleep23715781-21cut11:35:152
36314802121,8sleep03631513-21apt-get10:30:140
337132799129,1cyclictest0-21swapper/311:20:143
337132799121,9cyclictest3656580-21taskset10:45:303
337132799121,9cyclictest3418601-21turbostat07:45:003
3371327991210,0cyclictest0-21swapper/312:30:153
337132799120,9cyclictest3644270-21taskset10:40:023
337132799120,9cyclictest3404533-21taskset07:30:213
301798120,7rtkit-daemon3573819-21grep09:45:110
301798120,2rtkit-daemon0-21swapper/112:37:241
37545862110,8sleep13755394-21sed12:05:151
36720622110,4sleep03674123-21tr11:00:190
35028282111,7sleep13502984-21diskstats08:50:131
337132799111,8cyclictest36827852sleep311:10:113
337132799111,7cyclictest3438317-21taskset08:00:113
3371327991110,0cyclictest0-21swapper/308:45:393
33710992110,3sleep30-21swapper/307:08:463
301798110,3rtkit-daemon636-21snmpd08:10:380
37530122100,7sleep13753069-21awk12:00:211
37477122102,4sleep03747745-21apt-get12:00:120
36573702100,1sleep03657436-21/usr/sbin/munin10:50:120
36246242101,3sleep2636-21snmpd10:22:382
36017292100,4sleep23603826-21kthreadcore10:05:192
34072462101,2sleep1321rcuc/107:35:181
34055312101,6sleep03405551-21munin-run07:35:000
301798100,6rtkit-daemon3464536-21/usr/sbin/munin08:20:170
301798100,6rtkit-daemon3418590-21cron07:45:002
301798100,5rtkit-daemon3541613-21diskstats09:20:130
301798100,5rtkit-daemon3490360-21hddtemp_smartct08:40:140
301798100,5rtkit-daemon3407094-21sed07:35:162
301798100,4rtkit-daemon3377813-21munin-node12:21:091
301798100,3rtkit-daemon636-21snmpd11:25:551
301798100,3rtkit-daemon636-21snmpd10:25:440
301798100,1rtkit-daemon0-21swapper/009:00:300
3733924291,5sleep23734165-21grep11:45:242
3708707291,4sleep13708739-21apt-get11:30:121
3708101296,2sleep2376-21hwrng11:25:322
3695626292,3sleep23695648-21apt-get11:20:132
3689211291,4sleep03689233-21apt-get11:15:130
3580191291,4sleep13580224-21apt-get09:50:121
3477100291,4sleep23477122-21apt-get08:30:122
30179890,5rtkit-daemon636-21snmpd09:31:240
30179890,5rtkit-daemon3205-21sendmail-mta11:50:021
30179890,5rtkit-daemon3205-21sendmail-mta07:34:072
30179890,5rtkit-daemon317-21systemd-udevd10:39:330
30179890,4rtkit-daemon3608846-21cut10:10:180
30179890,4rtkit-daemon3440692-21grep08:00:180
30179890,2rtkit-daemon171rcu_preempt09:28:180
30179890,1rtkit-daemon0-21swapper/009:13:540
3773713281,4sleep23773868-21diskstats12:20:142
3729925280,5sleep03731284-21kthreadcore11:45:180
3727051281,4sleep03727108-21ntp_states11:40:180
3715163281,4sleep03715311-21diskstats11:35:120
3669700280,1sleep20-21swapper/211:00:012
3651844282,4sleep00-21swapper/010:45:170
3634312280,5sleep23636475-21kthreadcore10:30:202
3535018281,4sleep03535170-21df_inode09:15:120
3496377281,3sleep03496410-21apt-get08:45:120
3476704285,1sleep13474660-21kworker/u16:3+events_power_efficient08:28:221
3471087280,5sleep23471286-21irqcore08:25:142
3444992281,3sleep13445025-21apt-get08:05:111
3438724281,3sleep10-21swapper/108:00:171
3396897281,4sleep03398058-21memory07:25:190
3365515281,4sleep03366393-21irqrtprio07:05:150
30179880,5rtkit-daemon3377813-21munin-node10:05:150
30179880,5rtkit-daemon3205-21sendmail-mta09:52:530
30179880,4rtkit-daemon636-21snmpd11:21:131
30179880,4rtkit-daemon636-21snmpd11:13:501
30179880,4rtkit-daemon636-21snmpd09:42:450
30179880,4rtkit-daemon636-21snmpd08:29:480
30179880,4rtkit-daemon636-21snmpd07:21:562
30179880,4rtkit-daemon636-21snmpd07:15:052
30179880,4rtkit-daemon636-21snmpd07:10:362
30179880,4rtkit-daemon492-21gmain11:40:011
30179880,4rtkit-daemon413-21rpcbind08:30:370
30179880,4rtkit-daemon3377813-21munin-node12:28:281
30179880,4rtkit-daemon3377813-21munin-node09:35:040
30179880,4rtkit-daemon3377813-21munin-node08:06:300
30179880,4rtkit-daemon3377813-21munin-node07:26:452
30179880,4rtkit-daemon3205-21sendmail-mta11:35:131
30179880,4rtkit-daemon3205-21sendmail-mta08:55:120
30179880,3rtkit-daemon3663758-21df10:55:130
30179880,1rtkit-daemon0-21swapper/112:32:081
3782666271,3sleep2421rcuc/212:25:192
3650303270,4sleep23650349-21lsb_release10:43:142
3529503270,5sleep10-21swapper/109:10:181
3524112273,2sleep10-21swapper/109:05:161
3497581271,3sleep10-21swapper/108:45:171
3489965270,3sleep13489998-21apt-get08:40:111
3431537270,4sleep23431428-21apt-get07:55:012
3425254271,3sleep13425287-21apt-get07:50:121
3405788271,2sleep00-21swapper/007:35:120
3399534271,3sleep13399562-21fschecks_count07:30:161
3366394270,4sleep13367569-21grep07:05:161
30179870,4rtkit-daemon667-21lldpd12:10:191
30179870,4rtkit-daemon636-21snmpd09:05:530
30179870,4rtkit-daemon3377813-21munin-node10:23:000
30179870,4rtkit-daemon3377813-21munin-node10:15:080
30179870,3rtkit-daemon638-21ntpd11:16:551
30179870,3rtkit-daemon638-21ntpd11:05:290
30179870,3rtkit-daemon638-21ntpd07:06:132
30179870,3rtkit-daemon636-21snmpd12:18:321
30179870,3rtkit-daemon636-21snmpd10:43:380
30179870,3rtkit-daemon636-21snmpd10:02:280
30179870,3rtkit-daemon636-21snmpd07:50:282
30179870,3rtkit-daemon3484973-21irqrtprio08:35:140
30179870,3rtkit-daemon3377813-21munin-node09:56:080
30179870,3rtkit-daemon3377813-21munin-node08:50:090
30179870,3rtkit-daemon3205-21sendmail-mta11:57:061
30179870,3rtkit-daemon3200908-21packagekitd11:45:171
3787416260,3sleep03788342-21cut12:30:180
3785893260,1sleep00-21swapper/012:25:450
3760063260,1sleep00-21swapper/012:06:340
3741018260,4sleep03741061-21munin-run11:55:000
3702785261,3sleep03703779-21kthreadcore11:25:150
3676118260,3sleep13668935-21kworker/u16:0+ext4-rsv-conversion11:05:001
3669978261,2sleep20-21swapper/211:00:122
3613946260,4sleep23615965-21cut10:15:182
3600547260,4sleep13601728-21kthreadcore10:05:191
3589400260,3sleep23591560-21tr09:55:172
3485001260,3sleep13486253-21kthreadcore08:35:151
3457612260,4sleep23457619-21latency_hist08:15:002
3420297260,3sleep03421812-21grep07:45:170
3378047260,3sleep13378768-21grep07:15:011
30179860,3rtkit-daemon492-21gmain07:58:450
3798758250,1sleep00-21swapper/012:35:340
3792664250,1sleep20-21swapper/212:35:002
3779794250,1sleep00-21swapper/012:24:490
3762301250,3sleep23763780-21grep12:10:162
3755395250,3sleep23756561-21kthreadcore12:05:152
3747898250,3sleep20-21swapper/212:00:152
3747206250,1sleep00-21swapper/011:57:040
3734893250,2sleep23734903-21cpu11:50:142
3714612250,1sleep20-21swapper/211:31:452
3695808251,2sleep00-21swapper/011:20:140
3692648251,2sleep20-21swapper/211:15:192
3688789250,1sleep00-21swapper/011:13:010
3688594250,1sleep20-21swapper/211:10:312
3676408250,2sleep10-21swapper/111:05:121
3668863250,3sleep13668947-21sendmail_mailst10:55:231
3663229250,1sleep10-21swapper/110:53:501
3657638250,2sleep20-21swapper/210:50:142
3656239251,2sleep20-21swapper/210:45:222
3650104250,1sleep10-21swapper/110:40:401
3639430250,2sleep23641436-21grep10:35:162
3638520251,2sleep10-21swapper/110:35:151
3625060250,2sleep20-21swapper/210:25:102
3624762250,1sleep10-21swapper/110:24:251
3613033251,2sleep10-21swapper/110:15:171
3611608250,1sleep10-21swapper/110:10:311
3599015250,1sleep20-21swapper/210:03:152
3588059251,2sleep10-21swapper/109:55:161
3586020250,1sleep20-21swapper/209:50:452
3579667252,2sleep1331ktimers/109:46:311
3573402250,1sleep20-21swapper/209:43:272
3567024250,1sleep10-21swapper/109:38:541
3554539251,1sleep20-21swapper/209:30:132
3521552250,1sleep20-21swapper/209:01:482
3511737250,3sleep13513872-21kthreadcore08:55:191
3509193250,1sleep20-21swapper/208:55:042
3495861250,1sleep20-21swapper/208:41:382
3486255250,3sleep23488437-21grep08:35:162
3483153250,1sleep10-21swapper/108:33:111
3470180250,1sleep20-21swapper/208:21:372
3470174250,1sleep10-21swapper/108:21:321
3458265251,2sleep10-21swapper/108:15:161
3457897250,3sleep23457934-21cpu08:15:132
3457476250,1sleep10-21swapper/108:13:151
3439310250,3sleep23440438-21cut08:00:182
3437685250,1sleep10-21swapper/107:55:241
3424196250,2sleep13424312-21python307:45:221
3791942240,2sleep23792067-21timerandwakeup12:30:242
3773282240,3sleep20-21swapper/212:18:302
3767258240,1sleep00-21swapper/012:15:120
3747424240,3sleep20-21swapper/211:59:542
3727220240,1sleep20-21swapper/211:40:192
3653015241,1sleep10-21swapper/110:45:181
3631011240,3sleep10-21swapper/110:27:181
3611749240,2sleep23611750-21sshd10:12:202
3574425240,2sleep20-21swapper/209:45:152
3573312240,3sleep10-21swapper/109:42:181
3559619240,2sleep13559791-21strings09:30:201
3553689240,3sleep10-21swapper/109:25:481
3547580240,3sleep20-21swapper/209:24:452
3540854240,3sleep20-21swapper/209:16:192
3522253240,2sleep23522456-21smartctl09:05:132
3446396240,2sleep20-21swapper/208:05:162
3416141240,2sleep03417549-21/usr/sbin/munin07:40:170
3412821240,1sleep10-21swapper/107:40:131
3386535240,1sleep00-21swapper/007:20:130
3377431240,1sleep10-21swapper/107:11:501
3765902230,1sleep00-21swapper/012:10:180
3708705230,1sleep00-21swapper/011:30:110
3676458230,1sleep20-21swapper/211:05:132
3631516230,1sleep10-21swapper/110:30:151
3593078230,1sleep10-21swapper/110:00:131
3567010230,1sleep20-21swapper/209:38:432
3537910230,1sleep10-21swapper/109:15:171
3508225230,1sleep20-21swapper/208:50:222
3498792230,1sleep20-21swapper/208:45:182
3425482230,1sleep00-21swapper/007:50:150
3387990230,1sleep10-21swapper/107:20:181
3372958230,1sleep00-21swapper/007:10:160
3541409220,1sleep10-21swapper/109:20:021
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional