You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-17 - 10:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8s.osadl.org (updated Tue Mar 17, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
39841309910980,1094cyclictest40921962sleep320:34:573
3984130999661,961cyclictest4179602-21sleep21:40:003
72699240,8ntpd239751-21sed00:35:002
72699230,6ntpd4122783-21ntpq20:55:202
72699230,6ntpd4105221-21apt-get20:45:120
72699230,6ntpd4041320-21ntpq19:50:220
72699230,6ntpd3997652-21ntpq19:15:191
72699230,6ntpd3978073-21apt-get19:05:121
72699230,5ntpd4172666-21ssh21:35:132
72699230,5ntpd4123980-21apt-get21:00:111
72699230,5ntpd29706-21ssh22:10:111
72699230,2ntpd0-21swapper/022:45:200
72699220,8ntpd49331-21ntp_states22:20:210
72699220,8ntpd29107-21ssh22:08:581
72699220,7ntpd4136172-21diskmemload22:15:351
72699220,7ntpd4136172-21diskmemload00:11:071
72699220,6ntpd4192278-21ntp_states21:45:221
72699220,6ntpd4156172-21ntpq21:20:220
72699220,6ntpd3983120-21ntp_states19:05:210
72699220,6ntpd186685-21ntpq23:55:222
72699220,5ntpd65878-21apt-get22:35:122
72699220,5ntpd4165401-21apt-get21:30:100
72699220,5ntpd188740-21apt-get00:00:122
72699220,5ntpd181495-21apt-get23:55:121
72699220,5ntpd138177-21apt-get23:25:120
72699220,11ntpd116484-21/usr/sbin/munin23:10:262
72699220,10ntpd54969-21cut22:25:160
72699210,7ntpd4150563-21ssh21:19:402
72699210,7ntpd14086-21ssh21:58:081
72699210,6ntpd4136172-21diskmemload22:06:030
72699210,6ntpd4136172-21diskmemload21:55:280
72699210,6ntpd4122835-21ntpq20:55:220
72699210,6ntpd4072616-21ntpq20:15:241
72699210,6ntpd4072512-21ntpq20:15:222
72699210,6ntpd4016399-21ntpq19:30:222
72699210,6ntpd246299-21ssh00:37:502
72699210,5ntpd4194259-21ssh21:50:012
72699210,5ntpd4091286-21ntpq20:30:201
72699210,5ntpd4048533-21munin-run20:00:002
72699210,5ntpd36914-21apt-get22:15:132
72699210,5ntpd239939-21apt-get00:35:130
72699210,5ntpd223069-21ntpq00:20:200
72699210,5ntpd210908-21diskstats00:15:150
72699210,4ntpd93409-21sh22:51:110
72699210,4ntpd87556-21ssh22:50:121
72699210,4ntpd4179912-21apt-get21:40:121
72699210,4ntpd4104693-21apt-get20:45:012
72699210,4ntpd4022630-21ntpq19:35:222
72699210,1ntpd0-21swapper/223:50:202
72699200,9ntpd180237-21kworker/u16:3+xprtiod00:10:432
72699200,9ntpd102178-21/usr/sbin/munin23:00:150
72699200,6ntpd87261-21systemd-run22:50:011
72699200,6ntpd5604-21ntpq21:50:210
72699200,6ntpd202350-21ssh00:07:581
72699200,6ntpd180176-21ssh23:51:191
72699200,5ntpd4187098-21apt-get21:45:120
72699200,5ntpd4185063-21ntpq21:40:220
72699200,5ntpd4177818-21ntpq21:35:221
72699200,5ntpd4098440-21munin-run20:40:000
72699200,5ntpd4098440-21munin-run20:40:000
72699200,5ntpd4085101-21ntp_states20:25:202
72699200,5ntpd4030077-21apt-get19:45:121
72699200,5ntpd4011309-21sed19:30:002
72699200,5ntpd4005296-21diskstats19:25:121
72699200,5ntpd4005137-21apt-get19:25:110
72699200,5ntpd200888-21memory00:05:160
72699200,5ntpd165001-21ntpq23:40:221
72699200,5ntpd159900-21apt-get23:40:130
72699200,5ntpd107087-21ntpq23:00:202
72699200,5ntpd101681-21munin-run23:00:000
72699200,4ntpd73123-21apt-get22:40:140
72699200,4ntpd4136484-21apt-get21:10:101
72699200,4ntpd4136172-21diskmemload21:19:410
72699200,4ntpd4111468-21apt-get20:50:131
72699200,4ntpd4030237-21diskstats19:45:130
72699200,4ntpd4023843-21apt-get19:40:121
72699200,4ntpd37068-21df22:15:140
72699200,4ntpd143902-21ssh23:25:402
72699200,3ntpd80331-21ssh22:45:122
72699200,3ntpd230330-21ssh00:25:212
72699200,3ntpd107190-21ssh23:00:231
72699200,1ntpd0-21swapper/120:05:191
72699200,10ntpd0-21swapper/000:30:300
398413099207,9cyclictest4073499-21turbostat20:20:013
72699190,7ntpd137363-21ssh23:23:070
72699190,6ntpd4049079-21idleruntime20:00:152
72699190,6ntpd4003946-21ntpq19:20:212
72699190,6ntpd209774-21sh00:12:380
72699190,6ntpd115696-21ssh23:08:052
72699190,5ntpd4135291-21ntpq21:05:221
72699190,5ntpd4075141-21/usr/sbin/munin20:20:162
72699190,5ntpd4066293-21ntpq20:10:200
72699190,5ntpd4020550-21kthreadcore19:35:190
72699190,5ntpd231216-21sh00:26:521
72699190,5ntpd144002-21ssh23:26:021
72699190,5ntpd115409-21ssh23:07:031
72699190,4ntpd99829-21ntpq22:55:212
72699190,4ntpd4171154-21ssh21:30:382
72699190,4ntpd4158189-21apt-get21:25:112
72699190,4ntpd4136172-21diskmemload22:12:020
72699190,4ntpd4061269-21apt-get20:10:121
72699190,4ntpd3989469-21ntpq19:10:230
72699190,4ntpd225168-21apt-get00:25:130
72699190,4ntpd172123-21ntpq23:45:211
72699190,4ntpd121664-21ntpq23:10:220
72699190,3ntpd238984-21ssh00:32:431
72699190,2ntpd0-21swapper/019:30:200
72699190,1ntpd0-21swapper/023:55:220
72699180,5ntpd4168435-21kthreadcore21:30:151
72699180,5ntpd4159598-21kthreadcore21:25:150
72699180,5ntpd4158576-21irqcore21:25:141
72699180,5ntpd4097449-21ntpq20:35:201
72699180,5ntpd4097449-21ntpq20:35:201
72699180,5ntpd157720-21/usr/sbin/munin23:35:200
72699180,4ntpd50680-21ssh22:23:322
72699180,4ntpd4136764-21perl21:10:130
72699180,4ntpd4110290-21collect220:45:211
72699180,4ntpd4089958-21grep20:30:172
72699180,4ntpd4067506-21apt-get20:15:140
72699180,4ntpd4041889-21awk19:50:271
72699180,4ntpd4025226-21grep19:40:160
72699180,4ntpd4003900-21ld19:20:200
72699180,4ntpd35506-21ssh22:10:532
72699180,4ntpd28992-21ssh22:08:292
72699180,4ntpd223121-21ntp_states00:20:222
72699180,4ntpd217379-21ssh00:19:021
72699180,4ntpd196275-21hddtemp_smartct00:05:132
72699180,4ntpd161743-21grep23:40:182
72699180,4ntpd159363-21ssh23:39:192
72699180,4ntpd150575-21ntp_states23:30:222
72699180,4ntpd150521-21ntpq23:30:211
72699180,3ntpd7685-21ssh21:55:112
72699180,3ntpd4042546-21apt-get19:55:120
72699180,2ntpd14918-21ssh22:00:132
72699180,2ntpd130985-21ssh23:20:111
72699180,1ntpd0-21swapper/222:30:222
72699170,5ntpd210655-21runrttasks00:15:012
72699170,4ntpd78883-21ssh22:40:451
72699170,4ntpd4186355-21ssh21:43:242
72699170,4ntpd4177873-21ntpq21:35:230
72699170,4ntpd4156747-21ssh21:20:482
72699170,4ntpd4117902-21uniq20:55:141
72699170,4ntpd4103872-21ps20:40:242
72699170,4ntpd4049844-21cut20:00:150
72699170,4ntpd20118-21ntp_states22:00:210
72699170,4ntpd153054-21sed23:35:161
72699170,4ntpd123850-21df23:15:140
72699170,3ntpd92631-21ntpq22:50:202
72699170,3ntpd51390-21ssh22:25:111
72699170,3ntpd4143285-21ssh21:14:352
72699170,3ntpd4103766-21ntpq20:40:220
72699170,3ntpd4047783-21smartctl19:55:241
72699170,3ntpd244918-21ssh00:35:201
72699170,3ntpd174468-21df_inode23:50:130
72699170,3ntpd129632-21ssh23:16:162
72699170,3ntpd128847-21ntpq23:15:221
72699170,3ntpd121553-21ssh23:10:211
72699170,3ntpd0-21swapper/122:30:221
398413099171,13cyclictest152452-21taskset23:35:003
398413099171,12cyclictest4117728-21taskset20:55:113
72699160,4ntpd790-21mta-sts-daemon22:35:211
72699160,4ntpd5571-21ssh21:50:201
72699160,4ntpd4148840-21ssh21:15:191
72699160,4ntpd3998953-21grep19:20:131
72699160,4ntpd224837-21ssh00:25:001
72699160,4ntpd194785-21ssh00:01:451
72699160,4ntpd135390-21cut23:20:172
72699160,3ntpd73054-21ssh22:40:052
72699160,3ntpd4192235-21ssh21:45:222
72699160,3ntpd4154438-21ssh21:20:181
72699160,3ntpd3994416-21kthreadcore19:15:162
72699160,3ntpd113287-21kthreadcore23:05:170
72699160,3ntpd100651-21ssh22:56:111
72699160,2ntpd0-21swapper/220:10:192
72699160,2ntpd0-21swapper/220:05:182
72699160,2ntpd0-21swapper/219:10:212
72699160,2ntpd0-21swapper/122:20:111
72699160,2ntpd0-21swapper/023:30:130
72699160,2ntpd0-21swapper/022:30:130
72699160,2ntpd0-21swapper/020:25:190
398413099167,5cyclictest40350952sleep319:45:213
398413099165,7cyclictest1925722sleep300:00:183
3984130991613,1cyclictest0-21swapper/321:55:003
3984130991613,1cyclictest0-21swapper/320:22:033
3984130991613,1cyclictest0-21swapper/319:15:023
3984130991613,1cyclictest0-21swapper/300:12:423
398413099161,11cyclictest167280-21taskset23:45:143
72699150,3ntpd57324-21ssh22:26:162
72699150,3ntpd4051057-21kthreadcore20:00:171
72699150,3ntpd172828-21ssh23:45:442
72699150,3ntpd172520-21timerandwakeup23:45:260
72699150,2ntpd0-21swapper/221:00:212
72699150,2ntpd0-21swapper/220:50:202
72699150,2ntpd0-21swapper/220:35:132
72699150,2ntpd0-21swapper/220:35:122
72699150,2ntpd0-21swapper/122:00:211
72699150,2ntpd0-21swapper/120:40:231
72699150,2ntpd0-21swapper/120:20:211
72699150,2ntpd0-21swapper/119:35:131
72699150,2ntpd0-21swapper/021:00:190
72699150,2ntpd0-21swapper/020:50:210
72699150,2ntpd0-21swapper/020:20:210
72699150,2ntpd0-21swapper/020:05:110
72699150,2ntpd0-21swapper/019:15:210
72699150,2ntpd0-21swapper/000:00:190
72699150,1ntpd0-21swapper/022:39:110
398413099155,7cyclictest40808872sleep320:25:163
398413099155,7cyclictest174310-21taskset23:50:123
398413099155,6cyclictest1881242sleep323:58:583
398413099151,6cyclictest0-21swapper/323:35:183
3984130991513,1cyclictest0-21swapper/322:05:003
3984130991513,1cyclictest0-21swapper/320:54:483
3984130991513,0cyclictest0-21swapper/300:26:573
3984130991512,1cyclictest0-21swapper/323:21:053
3984130991512,1cyclictest0-21swapper/323:08:313
3984130991512,1cyclictest0-21swapper/323:00:333
3984130991512,1cyclictest0-21swapper/320:02:013
3984130991512,1cyclictest0-21swapper/319:27:573
3984130991512,1cyclictest0-21swapper/300:34:233
3984130991512,1cyclictest0-21swapper/300:19:323
398413099151,11cyclictest86109-21taskset22:45:513
398413099151,11cyclictest41610-21chrt22:15:193
398413099151,11cyclictest4156104-21taskset21:20:213
398413099151,11cyclictest4136416-21chrt21:10:023
398413099151,10cyclictest58587-21taskset22:30:093
398413099151,10cyclictest3998930-21taskset19:20:123
398413099151,10cyclictest116521-21taskset23:10:133
398413099150,11cyclictest4105174-21chrt20:45:013
72699140,2ntpd0-21swapper/219:50:182
72699140,2ntpd0-21swapper/219:45:202
72699140,2ntpd0-21swapper/120:25:181
72699140,2ntpd0-21swapper/020:30:190
72699140,1ntpd0-21swapper/221:05:212
398413099147,5cyclictest4165108-21turbostat21:34:563
398413099145,7cyclictest3989991-21taskset19:10:463
398413099145,7cyclictest28364-21taskset22:06:123
398413099145,6cyclictest130054-21taskset23:17:533
398413099144,7cyclictest2456842sleep300:35:373
398413099144,7cyclictest13445-21taskset21:55:423
3984130991412,1cyclictest0-21swapper/319:57:023
3984130991411,1cyclictest0-21swapper/321:48:163
398413099141,10cyclictest4143715-21taskset21:15:113
398413099141,10cyclictest4130376-21taskset21:05:143
398413099141,10cyclictest4101116-21chrt20:40:173
398413099141,10cyclictest4098378-21taskset20:39:343
398413099141,10cyclictest4098378-21taskset20:39:333
398413099141,10cyclictest4042102-21taskset19:53:013
398413099141,10cyclictest4022687-21taskset19:35:223
398413099141,10cyclictest34875-21taskset22:10:213
398413099141,10cyclictest202790-21taskset00:09:403
398413099141,10cyclictest166351-21taskset23:43:193
398413099141,10cyclictest101316-21chrt22:58:433
398413099141,10cyclictest0-21swapper/320:10:243
398413099140,6cyclictest0-21swapper/319:40:203
398413099140,11cyclictest93416-21chrt22:51:123
72699130,2ntpd0-21swapper/219:09:332
72699130,1ntpd0-21swapper/021:05:150
398413099133,8cyclictest0-21swapper/323:30:013
398413099131,9cyclictest71055-21taskset22:35:213
398413099131,9cyclictest44102-21chrt22:20:033
398413099131,9cyclictest4164620-21taskset21:28:133
398413099131,9cyclictest4129595-21taskset21:00:443
398413099131,9cyclictest4054992-21chrt20:05:033
398413099131,9cyclictest217949-21taskset00:20:103
398413099131,10cyclictest4017020-21taskset19:31:103
3984130991310,1cyclictest0-21swapper/321:43:193
398413099130,10cyclictest57645-21taskset22:27:333
72699120,2ntpd0-21swapper/119:10:151
72699120,1ntpd0-21swapper/219:40:182
72699120,1ntpd0-21swapper/119:30:161
398413099121,9cyclictest73077-21taskset22:40:113
3983626270,4sleep30-21swapper/319:05:273
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional