You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-26 - 22:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot8s.osadl.org (updated Fri Dec 26, 2025 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
24053019911620,1158cyclictest26720272sleep310:35:013
24053019910241,1019cyclictest2504116-21sleep08:25:003
2405301999971,991cyclictest2774894-21sleep11:54:593
240530199210,18cyclictest2523587-21sleep08:40:003
24275282200,8sleep02427695-21/usr/sbin/munin07:25:160
240530199197,9cyclictest2646118-21turbostat10:15:013
2405301991714,1cyclictest0-21swapper/307:20:003
240530199171,12cyclictest2633588-21taskset10:05:123
2405301991613,1cyclictest0-21swapper/312:17:503
2405301991613,1cyclictest0-21swapper/309:36:363
2405301991612,1cyclictest0-21swapper/312:30:013
240530199161,11cyclictest2478655-21taskset08:05:123
240530199156,5cyclictest2620490-21turbostat09:55:003
240530199155,8cyclictest2678487-21taskset10:40:033
240530199155,7cyclictest24613602sleep307:50:183
240530199155,7cyclictest2426982-21turbostat07:25:013
240530199153,9cyclictest2813690-21turbostat12:25:003
2405301991512,1cyclictest0-21swapper/312:00:213
2405301991512,1cyclictest0-21swapper/311:16:383
2405301991512,1cyclictest0-21swapper/311:10:023
2405301991512,1cyclictest0-21swapper/310:01:173
2405301991512,1cyclictest0-21swapper/307:43:023
2405301991512,1cyclictest0-21swapper/307:15:003
240530199150,11cyclictest2697476-21turbostat10:55:013
240530199141,9cyclictest2433671-21taskset07:30:103
2405301991413,0cyclictest0-21swapper/307:46:163
2405301991412,1cyclictest0-21swapper/312:07:483
2405301991412,1cyclictest0-21swapper/311:02:183
2405301991412,1cyclictest0-21swapper/309:57:133
2405301991412,0cyclictest0-21swapper/310:21:293
2405301991412,0cyclictest0-21swapper/309:34:193
240530199141,11cyclictest2762081-21turbostat11:44:593
2405301991411,1cyclictest0-21swapper/311:57:313
2405301991411,1cyclictest0-21swapper/309:43:003
2405301991411,1cyclictest0-21swapper/309:29:593
2405301991411,1cyclictest0-21swapper/308:30:513
240530199141,10cyclictest2798414-21taskset12:10:183
240530199141,10cyclictest2743045-21taskset11:30:113
240530199141,10cyclictest2575773-21chrt09:20:133
240530199141,10cyclictest2555465-21taskset09:02:133
240530199141,10cyclictest2504687-21taskset08:25:163
240530199141,10cyclictest2485227-21taskset08:10:133
240530199141,10cyclictest2472616-21taskset08:00:163
301798130,8rtkit-daemon2473087-21cut08:00:172
240530199134,7cyclictest2690148-21taskset10:45:193
240530199131,9cyclictest2471235-21taskset07:55:223
240530199131,8cyclictest27352512sleep311:20:233
2405301991312,0cyclictest0-21swapper/311:37:353
2405301991311,1cyclictest0-21swapper/312:35:573
2405301991311,1cyclictest0-21swapper/308:55:013
2405301991311,1cyclictest0-21swapper/308:16:443
240530199131,10cyclictest2671812-21turbostat10:35:003
240530199131,10cyclictest2575215-21turbostat09:19:593
240530199131,10cyclictest2562238-21taskset09:08:113
240530199131,10cyclictest2542579-21chrt08:51:453
2405301991310,1cyclictest0-21swapper/310:28:093
2405301991310,1cyclictest0-21swapper/309:47:223
2405301991310,1cyclictest0-21swapper/307:35:253
240530199130,9cyclictest2703180-21taskset10:55:203
240530199130,10cyclictest2427209-21taskset07:25:013
25565062121,8sleep02556669-21/usr/sbin/munin09:05:160
240530199129,1cyclictest0-21swapper/308:45:123
240530199129,1cyclictest0-21swapper/308:43:173
240530199124,6cyclictest25628282sleep309:10:123
240530199121,9cyclictest2722916-21chrt11:10:513
240530199121,8cyclictest2820305-21taskset12:30:003
240530199121,8cyclictest2820305-21taskset12:30:003
240530199121,8cyclictest2646343-21taskset10:15:023
2405301991211,0cyclictest0-21swapper/311:26:303
240530199120,9cyclictest2767560-21taskset11:45:183
301798110,7rtkit-daemon2555615-21seq09:04:111
301798110,7rtkit-daemon2411915-21munin-node10:22:511
27350952111,4sleep12735201-21ntpq11:20:211
26235822110,4sleep22625770-21kthreadcore09:55:182
301798100,6rtkit-daemon2773278-21kthreadcore11:50:211
301798100,5rtkit-daemon2613277-21/usr/sbin/munin09:45:201
301798100,5rtkit-daemon2581256-21unixbench_singl09:20:221
301798100,5rtkit-daemon2411805-21cut07:15:002
301798100,3rtkit-daemon492-21gmain09:31:011
27886752101,6sleep12789668-21/usr/sbin/munin12:05:151
27562132100,7sleep02756371-21/usr/sbin/munin11:40:180
26951562101,5sleep12696429-21memory10:50:181
25883762102,4sleep02588408-21apt-get09:30:120
25370702101,6sleep22537263-21sed08:50:152
24143232101,4sleep22414356-21apt-get07:15:112
30179890,5rtkit-daemon636-21snmpd12:20:011
30179890,5rtkit-daemon3205-21sendmail-mta11:30:321
30179890,5rtkit-daemon2509576-21strings08:25:201
30179890,5rtkit-daemon2495171-21kthreadcore08:15:201
30179890,5rtkit-daemon2484479-21taskset08:06:101
30179890,5rtkit-daemon2411915-21munin-node12:10:501
30179890,4rtkit-daemon2561544-21ntp_states09:05:211
30179890,1rtkit-daemon0-21swapper/111:58:301
2787267291,5sleep02787439-21wc12:00:210
2782820290,6sleep22784001-21grep12:00:162
2715414295,2sleep02715819-21needreboot11:05:160
2639006290,7sleep12639232-21sed10:05:231
2613228291,6sleep22613344-21python309:45:222
2500067291,5sleep22502151-21kthreadcore08:20:182
2463451291,5sleep02464508-21memory07:50:200
2433646292,3sleep22433668-21apt-get07:30:102
2427222291,4sleep12427255-21apt-get07:25:121
2399068291,3sleep22399101-21apt-get07:05:152
30179880,5rtkit-daemon3205-21sendmail-mta08:45:531
30179880,5rtkit-daemon317-21systemd-udevd10:15:341
30179880,4rtkit-daemon667-21lldpd10:55:031
30179880,4rtkit-daemon638-21ntpd09:25:201
30179880,4rtkit-daemon636-21snmpd12:35:131
30179880,4rtkit-daemon636-21snmpd09:40:101
30179880,4rtkit-daemon636-21snmpd09:19:481
30179880,4rtkit-daemon636-21snmpd08:20:281
30179880,4rtkit-daemon492-21gmain08:40:141
30179880,4rtkit-daemon3205-21sendmail-mta12:20:121
30179880,4rtkit-daemon3205-21sendmail-mta10:40:081
30179880,4rtkit-daemon2543122-21apt-get08:55:131
30179880,4rtkit-daemon2411915-21munin-node10:25:391
30179880,4rtkit-daemon2411915-21munin-node09:57:291
30179880,4rtkit-daemon2411915-21munin-node08:10:031
30179880,4rtkit-daemon2411915-21munin-node07:53:582
30179880,3rtkit-daemon2568086-21/usr/sbin/munin09:10:201
30179880,1rtkit-daemon0-21swapper/207:56:402
30179880,1rtkit-daemon0-21swapper/108:31:371
2826950281,4sleep02827150-21hddtemp_smartct12:35:110
2807914281,5sleep22807515-21/usr/sbin/munin12:20:152
2796372281,4sleep22798413-21cut12:10:172
2781798281,3sleep12781831-21apt-get12:00:111
2736783281,4sleep02736982-21hddtemp_smartct11:25:150
2697716281,3sleep02697749-21apt-get10:55:110
2672041281,3sleep22672074-21apt-get10:35:132
2639678281,4sleep0297-21systemd-journal10:09:550
2633573281,3sleep22633585-21apt-get10:05:122
2629626280,1sleep12631763-21kthreadcore10:00:191
2614327281,4sleep12614473-21df09:50:131
2557658280,5sleep22559238-21grep09:05:192
2548331281,4sleep22548402-21ntp_states08:55:212
2524020281,4sleep02524134-21/usr/sbin/munin08:40:160
2504347281,3sleep02504379-21apt-get08:25:130
2458310281,4sleep22458393-21sendmail_mailst07:45:212
2439044280,6sleep02439153-21find07:30:200
2416187280,5sleep12418252-21kthreadcore07:15:181
24053019985,1cyclictest0-21swapper/307:10:013
2399261281,4sleep02399388-21tail07:05:160
30179870,4rtkit-daemon638-21ntpd11:10:041
30179870,4rtkit-daemon638-21ntpd11:05:591
30179870,4rtkit-daemon492-21gmain11:00:291
30179870,4rtkit-daemon492-21gmain07:28:172
30179870,4rtkit-daemon3200908-21packagekitd11:41:491
30179870,4rtkit-daemon0-21swapper/110:10:411
30179870,3rtkit-daemon638-21ntpd12:31:161
30179870,3rtkit-daemon638-21ntpd12:31:151
30179870,3rtkit-daemon638-21ntpd10:30:191
30179870,3rtkit-daemon638-21ntpd07:21:362
30179870,3rtkit-daemon636-21snmpd11:48:081
30179870,3rtkit-daemon636-21snmpd11:15:211
30179870,3rtkit-daemon636-21snmpd10:36:311
30179870,3rtkit-daemon636-21snmpd08:50:451
30179870,3rtkit-daemon2904-21cron12:26:001
30179870,3rtkit-daemon2690236-21ntpq10:45:201
30179870,3rtkit-daemon2411915-21munin-node09:35:171
30179870,3rtkit-daemon2411915-21munin-node08:35:321
2815384270,4sleep02816602-21kthreadcore12:25:170
2762355270,4sleep02762507-21df_inode11:45:110
2749501270,4sleep12749642-21diskstats11:35:151
2736983271,3sleep12737544-21sed11:25:161
2736063270,4sleep02736110-21dpkg11:24:590
2710633270,4sleep22710780-21sh11:05:112
2536713270,4sleep02536869-21diskstats08:50:130
2517414271,2sleep20-21swapper/208:35:132
2510796270,4sleep22510942-21df08:30:122
2497632271,4sleep02497697-21munin-run08:20:010
2491852271,3sleep22492454-21irqrtprio08:15:182
2453001271,2sleep12453023-21apt-get07:45:111
2446579271,3sleep20-21swapper/207:40:112
2445282270,4sleep12445359-21ntp_states07:35:231
2441488270,4sleep22442927-21kthreadcore07:35:202
2434029271,3sleep12434221-21irqcore07:30:131
2405486270,4sleep02405635-21df_inode07:10:130
2822838262,2sleep02823484-21kthreadcore12:30:190
2822838262,2sleep02823484-21kthreadcore12:30:180
2801122260,3sleep02801274-21df_inode12:15:130
2800829260,3sleep02800873-21munin-run12:15:000
2767825260,4sleep22768070-21awk11:45:222
2748268260,3sleep22748345-21ntp_states11:30:182
2745821260,3sleep02748000-21cut11:30:160
2737545260,3sleep22738420-21grep11:25:172
2699672260,4sleep22700875-21kthreadcore10:55:172
2697460260,4sleep22697467-21latency_hist10:55:002
2671740260,1sleep00-21swapper/010:34:280
2665605261,2sleep20-21swapper/210:30:122
2654413261,3sleep22656462-21kthreadcore10:20:182
2653151261,2sleep00-21swapper/010:20:160
2633297260,4sleep22633340-21munin-run10:05:012
2601514261,2sleep00-21swapper/009:40:140
2581931261,2sleep02581964-21apt-get09:25:110
2575470261,2sleep00-21swapper/009:20:100
2549922260,3sleep02550366-21cut09:00:150
2535662260,3sleep02535787-21cat08:45:210
2523283260,1sleep00-21swapper/008:36:350
2516541260,1sleep00-21swapper/008:30:270
2486533260,3sleep22488540-21cut08:10:172
2474328260,3sleep12476423-21cut08:00:191
2445097260,1sleep00-21swapper/007:35:220
2820768251,2sleep20-21swapper/212:30:162
2820768251,2sleep20-21swapper/212:30:162
2819943250,1sleep20-21swapper/212:28:292
2807083250,1sleep20-21swapper/212:18:032
2781278250,1sleep20-21swapper/211:56:512
2757368250,2sleep20-21swapper/211:40:202
2731211250,3sleep20-21swapper/211:20:182
2729642250,1sleep20-21swapper/211:19:522
2728751250,2sleep00-21swapper/011:15:220
2717583251,2sleep22718530-21ps11:10:152
2710226250,1sleep20-21swapper/211:03:302
2697118250,1sleep00-21swapper/010:50:340
2690961250,1sleep20-21swapper/210:48:352
2690222250,3sleep02690270-21ps10:45:210
2684419250,3sleep00-21swapper/010:42:160
2659197251,2sleep22659261-21cpuspeed_turbos10:25:122
2641397250,3sleep22642594-21kthreadcore10:10:172
2628486250,2sleep00-21swapper/010:00:170
2620300250,1sleep00-21swapper/009:52:490
2614474250,3sleep22614563-21fschecks_time09:50:132
2607898250,2sleep00-21swapper/009:45:110
2601705250,3sleep22601824-21grep09:40:162
2581398250,1sleep20-21swapper/209:21:262
2575159250,1sleep00-21swapper/009:19:340
2574878250,1sleep20-21swapper/209:16:002
2564095251,2sleep22565516-21kthreadcore09:10:152
2530238250,2sleep20-21swapper/208:45:102
2523828250,2sleep20-21swapper/208:40:152
2484620250,1sleep00-21swapper/008:07:590
2478619250,2sleep20-21swapper/208:05:122
2473216251,2sleep00-21swapper/008:00:170
2466205251,2sleep00-21swapper/007:55:160
2452989251,2sleep00-21swapper/007:45:100
2452570250,1sleep10-21swapper/107:42:591
2446567250,1sleep00-21swapper/007:40:010
2425934251,2sleep12426075-21ntpq07:20:201
2412237251,2sleep02411660-21apt-get07:15:010
2405039250,1sleep10-21swapper/107:08:411
2827542240,2sleep22828526-21kthreadcore12:35:142
2813317240,3sleep00-21swapper/012:20:250
2794296240,3sleep20-21swapper/212:08:452
2774868240,1sleep00-21swapper/011:55:000
2769135240,1sleep20-21swapper/211:50:182
2749643240,2sleep22749841-21gltestperf11:35:162
2749480240,2sleep00-21swapper/011:35:140
2722923240,3sleep00-21swapper/011:10:580
2709995240,3sleep00-21swapper/011:00:310
2664988241,2sleep02405295-21cyclictest10:25:250
2646352240,3sleep20-21swapper/210:15:112
2646020240,3sleep00-21swapper/010:13:590
2600631240,3sleep20-21swapper/209:35:402
2595663240,2sleep02596282-21kthreadcore09:35:180
2594187240,3sleep20-21swapper/209:30:342
2584102240,1sleep20-21swapper/209:25:172
2551270240,2sleep22552668-21kthreadcore09:00:172
2497909240,1sleep00-21swapper/008:20:120
2459405240,1sleep10-21swapper/107:50:131
2408302240,2sleep12410493-21kthreadcore07:10:181
2794227230,1sleep00-21swapper/012:07:520
2770233230,1sleep00-21swapper/011:50:210
2678536230,1sleep20-21swapper/210:40:152
2672233230,1sleep00-21swapper/010:35:150
2646631230,1sleep00-21swapper/010:15:170
2621185230,1sleep00-21swapper/009:55:160
2562943230,1sleep00-21swapper/009:10:140
2543082230,1sleep00-21swapper/008:55:070
2504537230,1sleep20-21swapper/208:25:162
2485033230,1sleep00-21swapper/008:10:110
2466896230,1sleep10-21swapper/107:55:171
2424626230,1sleep00-21swapper/007:20:180
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional