You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-08 - 19:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot7s.osadl.org (updated Tue Sep 08, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1220729066,8sleep20-21swapper/207:08:522
1204128774,9sleep00-21swapper/007:06:410
1223328666,9sleep30-21swapper/307:09:133
1209927958,6sleep10-21swapper/107:07:261
15922570,0sleep10-21swapper/110:24:561
1240599260,26cyclictest0-21swapper/210:21:402
1240599240,23cyclictest0-21swapper/212:13:042
1240599230,1cyclictest0-21swapper/209:34:062
1240599220,22cyclictest0-21swapper/209:19:562
1240399220,1cyclictest0-21swapper/111:12:441
12408992120,1cyclictest5386-21diskmemload10:19:113
1239999210,1cyclictest0-21swapper/011:41:410
1240599200,20cyclictest0-21swapper/212:01:282
1240399200,3cyclictest22726-21latency_hist07:30:001
12408991916,2cyclictest0-21swapper/311:00:163
1240599190,18cyclictest0-21swapper/211:37:122
1239999190,1cyclictest0-21swapper/012:15:290
1239999190,19cyclictest0-21swapper/012:24:120
1240899180,1cyclictest0-21swapper/309:27:393
12405991717,0cyclictest0-21swapper/209:25:132
12405991717,0cyclictest0-21swapper/208:10:192
12403991716,1cyclictest0-21swapper/109:30:581
12399991712,4cyclictest13-21ksoftirqd/010:45:130
12399991712,4cyclictest13-21ksoftirqd/009:34:190
12399991712,1cyclictest13-21ksoftirqd/010:13:050
1239999170,12cyclictest0-21swapper/008:20:160
1240399161,14cyclictest5386-21diskmemload10:39:391
12403991611,3cyclictest0-21swapper/111:40:421
1240399160,12cyclictest0-21swapper/112:15:501
1239999165,7cyclictest24252-21apt-get11:55:130
12408991514,1cyclictest0-21swapper/312:20:133
1240899150,1cyclictest0-21swapper/309:00:123
12405991515,0cyclictest0-21swapper/210:12:202
12405991514,1cyclictest0-21swapper/210:54:482
1240599150,1cyclictest0-21swapper/211:24:572
12403991510,5cyclictest38150irq/131-snd_hda11:04:431
1240399150,2cyclictest0-21swapper/111:37:441
1240399150,14cyclictest0-21swapper/110:43:181
1239999150,1cyclictest141rcu_preempt12:10:240
12408991412,1cyclictest1969-21sh11:22:123
1240899141,1cyclictest141rcu_preempt11:48:163
12408991410,3cyclictest29303-21wc10:40:263
1240599148,6cyclictest8314-21apache211:26:482
1240599141,5cyclictest0-21swapper/208:40:162
12405991411,2cyclictest23496-21cron08:40:002
1240599141,12cyclictest0-21swapper/212:29:272
1240599141,12cyclictest0-21swapper/211:55:152
12405991411,2cyclictest0-21swapper/210:08:322
12405991411,2cyclictest0-21swapper/210:08:312
1240599140,2cyclictest0-21swapper/211:10:132
1240599140,14cyclictest0-21swapper/209:12:382
1240599140,13cyclictest0-21swapper/211:50:372
1240599140,12cyclictest0-21swapper/209:37:172
1240399141,8cyclictest10114-21ssh10:10:191
12403991412,2cyclictest0-21swapper/112:05:351
1240399141,11cyclictest0-21swapper/109:35:211
12403991410,2cyclictest17036-21wc11:50:191
1240399140,13cyclictest0-21swapper/111:55:251
1239999148,5cyclictest181irq_work/010:19:500
12399991412,1cyclictest161rcuc/012:00:150
12399991411,2cyclictest16347-21wc11:30:250
12399991410,3cyclictest2528-21grep07:55:150
12399991410,3cyclictest21667-21grep08:35:150
12399991410,1cyclictest13-21ksoftirqd/012:07:400
12399991410,1cyclictest13-21ksoftirqd/011:35:240
1239999140,8cyclictest6818-21awk08:05:000
1240899139,3cyclictest26174-21grep11:55:273
1240899139,3cyclictest22843-21basename09:20:143
1240899133,6cyclictest39-21ksoftirqd/311:35:133
1240899131,3cyclictest141rcu_preempt09:45:183
12408991310,2cyclictest4922-21sed09:05:263
12408991310,2cyclictest4097-21cat10:25:243
12408991310,2cyclictest29257-21grep07:40:273
12408991310,2cyclictest23477-21grep07:30:213
12408991310,2cyclictest23462-21cron09:40:003
12408991310,2cyclictest17679-21sed11:50:253
12408991310,2cyclictest15453-21cat09:15:203
12408991310,2cyclictest12794-21grep10:30:283
1240899130,12cyclictest21202-21grep10:35:283
1240899130,12cyclictest2022-21cron07:55:003
1240899130,10cyclictest6046-21apache_processe11:25:113
1240599139,3cyclictest1510-21grep09:00:152
1240599135,4cyclictest225-21systemd-journal10:30:042
12405991310,2cyclictest29736-21cat11:20:002
12405991310,2cyclictest25859-21ls12:35:002
12405991310,2cyclictest24820-21grep09:40:182
12405991310,2cyclictest19201-21tr07:20:222
1240599130,2cyclictest0-21swapper/207:11:172
1240399139,2cyclictest24065-21cut09:40:141
1240399139,2cyclictest15387-21wc07:15:011
1240399138,3cyclictest5364-21cron09:10:001
1240399131,3cyclictest225-21systemd-journal09:55:001
12403991312,1cyclictest0-21swapper/110:19:111
12403991310,2cyclictest7996-21grep11:25:251
12403991310,2cyclictest7958-21sed11:45:171
12403991310,2cyclictest29286-21grep08:50:161
12403991310,2cyclictest27275-21head08:45:211
12403991310,2cyclictest24629-21wc10:00:001
12403991310,2cyclictest1925-21wc12:40:001
12403991310,2cyclictest12969-21grep08:15:181
12403991310,2cyclictest12969-21grep08:15:181
12403991310,2cyclictest11752-21cat08:15:001
1240399130,9cyclictest4428-21idleruntime-cro08:00:001
1239999139,3cyclictest9225-21cron08:10:000
1239999139,3cyclictest3151-21grep10:25:160
1239999139,3cyclictest2533-21tail09:00:250
12399991312,1cyclictest0-21swapper/011:09:310
12399991310,2cyclictest28366-21tail07:40:170
12399991310,2cyclictest23888-21cat11:55:000
12399991310,2cyclictest17773-21wc09:55:200
1239999130,7cyclictest0-21swapper/009:26:410
1239999130,12cyclictest19970-21grep12:30:260
1240899129,2cyclictest9534-21tr08:10:143
1240899129,2cyclictest25404-21head09:40:233
1240899129,2cyclictest2057-21unixbench-2d12:00:263
1240899129,2cyclictest20466-21cat08:30:233
1240899129,2cyclictest17503-21cron12:29:593
1240899129,2cyclictest12594-21tr10:50:153
1240899128,3cyclictest7507-21expr09:30:153
1240899128,3cyclictest19675-21ssh12:30:253
1240899122,10cyclictest0-21swapper/309:55:503
1240899121,10cyclictest0-21swapper/312:10:013
1240899120,11cyclictest0-21swapper/308:45:133
1240599129,2cyclictest9789-21sort12:05:202
1240599129,2cyclictest8320-21sed11:45:182
1240599129,2cyclictest4952-21tr08:00:152
1240599129,2cyclictest4437-21basename08:00:002
1240599129,2cyclictest29566-21tail10:40:272
1240599128,3cyclictest32-21ksoftirqd/210:25:102
1240599124,4cyclictest225-21systemd-journal11:05:002
12405991210,1cyclictest4727-21chrt11:05:052
1240599120,8cyclictest3760-21grep10:45:152
1240599120,12cyclictest0-21swapper/212:38:022
1240399129,2cyclictest5829-21ntpq08:00:201
1240399129,2cyclictest3782-21head10:25:211
1240399129,2cyclictest26838-21tail07:35:251
1240399129,2cyclictest21627-21tr08:35:151
1240399129,2cyclictest20257-21grep08:30:211
1240399129,2cyclictest1587-21sed12:00:211
1240399129,2cyclictest1503-21cut12:20:131
1240399129,2cyclictest14292-21basename08:20:161
1240399129,2cyclictest13792-21sh09:14:591
1240399129,2cyclictest12623-21wc10:30:281
1240399128,3cyclictest9223-21cron08:10:001
1240399128,3cyclictest16447-21grep11:30:261
1240399127,4cyclictest4003-21rm11:23:471
1240399127,4cyclictest23877-21ssh12:33:271
1240399127,4cyclictest23339-21ssh09:20:161
1240399124,4cyclictest225-21systemd-journal09:50:001
1240399122,9cyclictest5386-21diskmemload12:26:221
1240399121,1cyclictest0-21swapper/110:05:141
1240399121,1cyclictest0-21swapper/110:05:131
1239999129,2cyclictest9771-21grep12:25:150
1239999129,2cyclictest31578-21sed07:45:250
1239999129,2cyclictest29296-21sed08:50:160
1239999129,2cyclictest24398-21grep08:40:190
1239999129,2cyclictest23645-21grep11:15:260
1239999128,3cyclictest7298-21tr09:10:210
1239999128,3cyclictest19180-21grep07:20:200
1239999128,3cyclictest13362-21wc08:15:250
1239999128,3cyclictest13362-21wc08:15:240
1239999128,2cyclictest655-21cut07:50:150
1239999128,2cyclictest24174-21grep09:40:140
1239999128,2cyclictest15427-21wc11:50:000
1239999122,6cyclictest13-21ksoftirqd/012:35:250
1239999121,7cyclictest5386-21diskmemload10:54:510
12399991211,1cyclictest5386-21diskmemload10:24:060
12399991210,1cyclictest15188-21cron07:15:000
1239999120,6cyclictest623-21basename09:00:000
1240899118,2cyclictest9643-21ssh12:05:193
1240899118,2cyclictest9230-21ssh09:50:193
1240899118,2cyclictest7850-21rm10:47:133
1240899118,2cyclictest5696-21tail11:05:163
1240899118,2cyclictest3282-21sh10:05:383
1240899118,2cyclictest3282-21sh10:05:383
1240899118,2cyclictest31063-21cat07:45:193
1240899118,2cyclictest29873-21ssh12:36:363
1240899118,2cyclictest29500-21cat08:50:183
1240899118,2cyclictest26394-21ls07:35:213
1240899118,2cyclictest25964-21ssh10:20:033
1240899118,2cyclictest25885-21grep10:00:153
1240899118,2cyclictest25114-21ssh12:15:073
1240899118,2cyclictest24793-21rm11:16:153
1240899118,2cyclictest21184-21grep07:25:163
1240899118,2cyclictest18154-21aten2_r7power_p07:20:153
1240899118,2cyclictest17419-21tail08:25:183
1240899118,2cyclictest15731-21tr07:15:153
1240899118,2cyclictest15041-21df11:30:143
1240899118,2cyclictest13992-21rm10:12:273
1240899118,2cyclictest12480-21sort08:15:153
1240899118,2cyclictest12480-21sort08:15:153
1240899117,2cyclictest7286-21grep09:10:213
1240899115,2cyclictest39-21ksoftirqd/308:55:183
1240899112,1cyclictest141rcu_preempt10:57:303
1240599119,2cyclictest4042-21ssh12:21:032
1240599118,2cyclictest32567-21tr07:50:142
1240599118,2cyclictest32227-21ssh09:45:082
1240599118,2cyclictest31683-21head08:55:142
1240599118,2cyclictest28581-21ssh10:01:362
1240599118,2cyclictest26954-21grep08:45:182
1240599118,2cyclictest25607-21expr12:15:132
1240599118,2cyclictest22474-21ssh09:20:032
1240599118,2cyclictest22133-21grep07:25:262
1240599118,2cyclictest21326-21seq10:35:292
1240599118,2cyclictest19288-21cut08:30:142
1240599118,2cyclictest16224-21cut07:15:182
1240599118,2cyclictest14939-21cat11:30:142
1240599118,2cyclictest12910-21ssh09:52:272
1240599118,2cyclictest1083-21taskset11:40:282
1240599117,3cyclictest17252-21ssh09:55:152
1240599117,2cyclictest28339-21tr07:40:182
1240599114,5cyclictest0-21swapper/207:35:212
1240599114,4cyclictest19841-21unixbench_singl10:15:282
1240599114,3cyclictest225-21systemd-journal10:55:172
1240599113,4cyclictest225-21systemd-journal08:30:002
1240399118,2cyclictest5820-21ssh10:45:371
1240399118,2cyclictest4729-21sh11:05:051
1240399118,2cyclictest4432-21ssh09:28:141
1240399118,2cyclictest32276-21cat07:50:001
1240399118,2cyclictest29489-21ssh10:02:181
1240399118,2cyclictest29146-21sed07:40:261
1240399118,2cyclictest22038-21grep11:15:141
1240399118,2cyclictest21777-21head10:55:201
1240399118,2cyclictest19782-21ssh12:11:081
1240399118,2cyclictest17295-21tune2fs08:25:181
1240399118,2cyclictest14964-21ssh09:15:161
1240399118,2cyclictest12908-21ssh10:50:161
1240399116,4cyclictest24922-21taskset07:34:581
1240399111,9cyclictest17165-21unixbench_singl07:15:271
1240399110,8cyclictest38150irq/131-snd_hda08:40:151
1239999119,1cyclictest6082-21ssh11:25:120
1239999119,1cyclictest13-21ksoftirqd/011:13:330
1239999118,2cyclictest3671-21chrt09:46:490
1239999118,2cyclictest31321-21wc11:20:190
1239999118,2cyclictest29849-21tail11:00:200
1239999118,2cyclictest2800-21cat10:05:260
1239999118,2cyclictest2800-21cat10:05:260
1239999118,2cyclictest27926-21taskset08:45:390
1239999118,2cyclictest22800-21ssh10:36:390
1239999118,2cyclictest22642-21acpi09:20:120
1239999118,2cyclictest21647-21sed07:25:210
1239999118,2cyclictest20713-21head08:30:240
1239999118,2cyclictest14425-21tr09:15:140
1239999118,2cyclictest11249-21tr10:30:170
1239999112,4cyclictest0-21swapper/008:30:000
12399991110,1cyclictest0-21swapper/009:36:190
1239999110,10cyclictest23709-21chrt10:56:210
1240899108,1cyclictest7062-21apache_processe08:05:123
1240899108,1cyclictest321142sleep311:40:163
1240899108,1cyclictest2481-21egrep07:55:153
1240899108,1cyclictest23225-21taskset08:36:343
1240899107,2cyclictest5423-21grep08:00:173
1240899107,2cyclictest24079-21expr08:40:183
1240899107,2cyclictest14542-21grep11:10:183
1240899107,2cyclictest12939-21awk07:10:143
1240899100,9cyclictest14255-21basename08:20:133
1240599108,1cyclictest7637-21sh08:05:152
1240599108,1cyclictest29003-21expr08:50:142
1240599107,2cyclictest4002-21grep09:05:182
1240599107,2cyclictest30179-21cpuspeed_turbos07:45:142
1240599107,2cyclictest13565-21head08:15:252
1240599107,2cyclictest13565-21head08:15:252
1240599100,9cyclictest23210-21cat07:30:182
1240399108,1cyclictest424-21chrt08:58:251
1240399107,2cyclictest977-21wget09:00:131
1240399100,9cyclictest32447-21awk07:50:121
1239999108,1cyclictest24891-21ssh10:00:050
1239999108,1cyclictest16893-21sed07:15:260
1239999107,2cyclictest24528-21grep07:30:290
1239999107,2cyclictest12535-21rm09:52:100
1239999102,7cyclictest0-21swapper/010:40:460
124059996,2cyclictest16155-21taskset08:22:132
124039996,2cyclictest18509-21expr07:20:161
123999998,1cyclictest10543-21sed08:10:200
123999997,1cyclictest3269-21apt-get09:05:130
123999997,1cyclictest271022sleep007:37:310
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional