You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-14 - 10:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8s.osadl.org (updated Sun Dec 14, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22551059911890,1185cyclictest24180032sleep321:14:573
2255105992590,256cyclictest2295759-21turbostat19:44:553
249558621070,1sleep10-21swapper/122:15:001
225510599241,19cyclictest2656342-21turbostat00:20:003
2255105991916,1cyclictest0-21swapper/322:20:013
26819472171,13sleep02681971-21munin-run00:39:590
225510599171,13cyclictest2334569-21turbostat20:10:013
225510599165,7cyclictest22549502sleep319:10:013
2255105991614,0cyclictest0-21swapper/322:55:163
2255105991614,0cyclictest0-21swapper/322:55:153
23466732151,11sleep22346803-21xargs20:15:222
22557102151,5sleep22256708-21irqstats19:10:132
225510599156,7cyclictest2624372-21taskset23:55:023
225510599155,7cyclictest23733912sleep320:40:123
2255105991513,1cyclictest0-21swapper/321:25:013
2255105991513,0cyclictest0-21swapper/321:25:233
2255105991512,1cyclictest0-21swapper/321:05:253
2255105991512,1cyclictest0-21swapper/320:15:333
225510599151,10cyclictest2443759-21sleep21:35:003
225510599150,6cyclictest0-21swapper/323:50:103
225510599150,12cyclictest2321838-21taskset20:00:003
225510599144,7cyclictest2572312-21taskset23:12:153
2255105991412,1cyclictest0-21swapper/323:33:563
2255105991412,1cyclictest0-21swapper/322:14:303
2255105991412,1cyclictest0-21swapper/320:50:183
2255105991412,1cyclictest0-21swapper/300:29:083
2255105991412,0cyclictest0-21swapper/323:01:203
2255105991412,0cyclictest0-21swapper/319:28:173
2255105991412,0cyclictest0-21swapper/300:38:103
225510599141,10cyclictest2604177-21chrt23:35:233
225510599141,10cyclictest2578716-21taskset23:17:243
225510599141,10cyclictest2546802-21turbostat22:55:003
225510599141,10cyclictest2540391-21turbostat22:50:013
225510599141,10cyclictest2533921-21taskset22:44:163
225510599141,10cyclictest2527210-21chrt22:35:413
225510599141,10cyclictest2482897-21taskset22:05:123
225510599141,10cyclictest2470159-21taskset21:55:113
225510599141,10cyclictest2419094-21taskset21:15:163
225510599141,10cyclictest2398584-21chrt20:57:503
225510599141,10cyclictest23605092sleep320:30:153
225510599141,10cyclictest23605092sleep320:30:143
225510599140,11cyclictest2289340-21turbostat19:34:593
225510599134,6cyclictest26382582sleep300:05:173
225510599131,9cyclictest2669401-21taskset00:30:123
225510599131,9cyclictest2636699-21chrt00:00:523
225510599131,9cyclictest2617434-21taskset23:46:263
225510599131,9cyclictest2591456-21taskset23:25:413
225510599131,9cyclictest2456025-21taskset21:40:203
225510599131,9cyclictest2372822-21taskset20:36:423
225510599131,9cyclictest2349159-21taskset20:20:163
2255105991311,1cyclictest0-21swapper/321:51:153
2255105991311,1cyclictest0-21swapper/321:35:233
2255105991311,1cyclictest0-21swapper/319:37:523
2255105991311,1cyclictest0-21swapper/319:10:123
225510599131,10cyclictest2649707-21taskset00:12:383
225510599131,10cyclictest2507961-21chrt22:21:113
2255105991311,0cyclictest0-21swapper/320:12:043
2255105991310,1cyclictest0-21swapper/322:00:273
2255105991310,1cyclictest0-21swapper/320:05:003
2255105991310,1cyclictest0-21swapper/300:22:503
225510599130,11cyclictest2385968-21chrt20:50:003
301798120,6rtkit-daemon2475305-21ntp_states21:55:181
25429662124,5sleep22545137-21cut22:50:162
23605462121,4sleep02360698-21/usr/sbin/munin20:30:160
23605462121,4sleep02360698-21/usr/sbin/munin20:30:150
225510599123,7cyclictest2404938-21taskset21:01:383
225510599121,9cyclictest2579186-21taskset23:20:013
225510599121,9cyclictest2462919-21chrt21:45:253
225510599121,9cyclictest2269992-21taskset19:18:493
225510599121,8cyclictest2302660-21taskset19:45:093
2255105991210,1cyclictest0-21swapper/322:28:263
225510599120,9cyclictest2611060-21taskset23:41:283
225510599120,9cyclictest2559951-21chrt23:05:073
225510599120,9cyclictest2520750-21taskset22:30:253
225510599120,9cyclictest2309391-21taskset19:50:153
225510599120,9cyclictest2276207-21taskset19:21:023
301798110,7rtkit-daemon2468870-21ntpq21:50:211
301798110,3rtkit-daemon3205-21sendmail-mta22:28:291
225510599119,1cyclictest0-21swapper/320:25:213
301798100,7rtkit-daemon636-21snmpd00:08:531
301798100,6rtkit-daemon317-21systemd-udevd00:13:321
301798100,6rtkit-daemon2611619-21acpi23:45:121
301798100,6rtkit-daemon2404970-21taskset21:02:031
301798100,5rtkit-daemon2548449-21cut22:55:161
301798100,5rtkit-daemon2548449-21cut22:55:151
301798100,5rtkit-daemon2309411-21gltestperf19:50:141
301798100,4rtkit-daemon430-21avahi-daemon20:34:091
301798100,4rtkit-daemon430-21avahi-daemon20:34:081
25780882100,8sleep12572779-21/usr/sbin/munin23:15:191
25275472100,7sleep02527643-21sed22:40:010
25096152100,7sleep22510797-21cut22:25:152
24906512100,7sleep02491833-21cut22:10:150
22893202101,6sleep22289497-21latency_hist19:35:002
30179890,5rtkit-daemon636-21snmpd20:25:451
30179890,5rtkit-daemon317-21systemd-udevd21:39:341
30179890,4rtkit-daemon636-21snmpd00:15:251
30179890,4rtkit-daemon2660806-21tr00:20:171
30179890,4rtkit-daemon2418129-21sed21:15:011
30179890,4rtkit-daemon2383934-21cut20:45:211
30179890,4rtkit-daemon2270359-21/usr/sbin/munin19:20:131
30179890,1rtkit-daemon0-21swapper/122:33:471
30179890,1rtkit-daemon0-21swapper/120:09:121
2656839291,5sleep22657036-21iwlist00:20:142
2631838290,6sleep22633095-21cat00:00:162
2580476290,7sleep12581679-21kthreadcore23:20:161
2520186291,4sleep22520262-21ntp_states22:30:212
2495675291,5sleep02495697-21apt-get22:15:120
2418007291,5sleep22418024-21munin-run21:15:012
2405851291,5sleep02405948-21grep21:05:160
2399031291,4sleep02399064-21apt-get21:00:130
2397934292,4sleep22398058-21python320:55:222
2341717290,6sleep02342699-21kernelversion20:15:160
2253971291,5sleep22248824-21/usr/sbin/munin19:05:152
30179880,4rtkit-daemon667-21lldpd22:07:031
30179880,4rtkit-daemon636-21snmpd23:36:141
30179880,4rtkit-daemon636-21snmpd23:30:161
30179880,4rtkit-daemon636-21snmpd23:13:351
30179880,4rtkit-daemon636-21snmpd23:00:211
30179880,4rtkit-daemon636-21snmpd22:01:131
30179880,4rtkit-daemon636-21snmpd21:40:351
30179880,4rtkit-daemon636-21snmpd20:55:361
30179880,4rtkit-daemon636-21snmpd19:46:061
30179880,4rtkit-daemon492-21gmain23:06:101
30179880,4rtkit-daemon492-21gmain22:19:301
30179880,4rtkit-daemon492-21gmain00:30:141
30179880,4rtkit-daemon448-21wpa_supplicant20:35:471
30179880,4rtkit-daemon447-21systemd-logind20:11:331
30179880,4rtkit-daemon3200908-21packagekitd21:26:301
30179880,4rtkit-daemon297-21systemd-journal20:24:441
30179880,4rtkit-daemon2531618-21grep22:40:191
30179880,4rtkit-daemon2261651-21munin-node23:51:401
30179880,4rtkit-daemon2261651-21munin-node23:41:101
30179880,4rtkit-daemon2261651-21munin-node22:51:171
30179880,4rtkit-daemon2261651-21munin-node20:54:491
30179880,4rtkit-daemon2221906-21munin-node19:05:521
30179880,3rtkit-daemon2426178-21irqstats21:20:161
30179880,1rtkit-daemon0-21swapper/122:46:281
2651641280,5sleep22653607-21cut00:15:182
2624420281,4sleep12624566-21df23:55:131
2624384282,3sleep02624417-21apt-get23:55:120
2579198280,4sleep02579231-21apt-get23:20:110
2502140281,4sleep12502292-21df_inode22:20:151
2443115281,4sleep22443359-21users21:30:232
2437571281,3sleep12437604-21apt-get21:30:101
2373689281,5sleep12373355-21/usr/sbin/munin20:40:141
2372955281,5sleep2636-21snmpd20:38:262
2359547280,5sleep22359682-21sed20:25:202
2322001281,3sleep12322034-21apt-get20:00:111
2294967281,5sleep10-21swapper/119:35:231
2294890281,5sleep02294966-21awk19:35:220
2271340280,1sleep00-21swapper/019:20:150
30179870,4rtkit-daemon492-21gmain19:57:501
30179870,4rtkit-daemon492-21gmain00:26:211
30179870,3rtkit-daemon638-21ntpd23:27:061
30179870,3rtkit-daemon636-21snmpd21:15:241
30179870,3rtkit-daemon636-21snmpd20:15:071
30179870,3rtkit-daemon492-21gmain19:30:251
30179870,3rtkit-daemon2632296-21irqstats00:00:151
30179870,3rtkit-daemon2463135-21seq21:48:101
30179870,3rtkit-daemon2262057-21munin-node19:15:031
30179870,3rtkit-daemon2261651-21munin-node19:40:371
30179870,3rtkit-daemon2261651-21munin-node19:27:511
30179870,3rtkit-daemon2221906-21munin-node19:12:071
2675812270,3sleep22675845-21apt-get00:35:132
2635260271,3sleep02636021-21cat00:00:180
2559958270,3sleep02559991-21apt-get23:05:120
2559524270,1sleep00-21swapper/023:02:440
2522611270,5sleep12523788-21grep22:35:161
2502104271,3sleep02502137-21apt-get22:20:140
2470360270,4sleep02470482-21cut21:55:130
2457476270,4sleep02457642-21sed21:45:150
2444442270,5sleep02444634-21expr21:35:130
2405954271,3sleep12406950-21ps21:05:171
2354100270,3sleep02354122-21apt-get20:25:100
2328392270,3sleep22328424-21apt-get20:05:142
2321724271,3sleep22321835-21latency_hist20:00:012
2301572271,3sleep22301678-21sendmail_mailtr19:40:222
2270556270,4sleep22270757-21hddtemp_smartct19:20:132
2265582270,4sleep20-21swapper/219:15:252
2257981271,4sleep00-21swapper/019:10:140
30179860,3rtkit-daemon492-21gmain00:37:211
2605771260,4sleep22606710-21kthreadcore23:40:162
2597925260,1sleep00-21swapper/023:31:080
2579380261,2sleep20-21swapper/223:20:132
2431563261,3sleep02431160-21/usr/sbin/munin21:25:170
2430064260,1sleep20-21swapper/221:20:222
2418663261,2sleep20-21swapper/221:15:162
2392593261,2sleep02392626-21apt-get20:55:120
2386183260,2sleep22386216-21apt-get20:50:122
2309088261,2sleep02309121-21apt-get19:50:120
2251007260,3sleep02253167-21kthreadcore19:05:130
2670638251,2sleep02671872-21kthreadcore00:30:190
2656266250,1sleep00-21swapper/000:19:290
2649587250,1sleep20-21swapper/200:11:052
2639389251,2sleep00-21swapper/000:05:190
2624371250,3sleep20-21swapper/223:55:022
2624098250,3sleep20-21swapper/223:54:382
2617538250,1sleep20-21swapper/223:47:462
2598753251,2sleep20-21swapper/223:35:162
2590197250,1sleep00-21swapper/023:25:200
2572196250,1sleep00-21swapper/023:10:460
2548493251,2sleep20-21swapper/222:55:172
2548493251,2sleep20-21swapper/222:55:172
2541037250,3sleep02541710-21cut22:50:140
2534017250,3sleep00-21swapper/022:45:020
2527827250,2sleep20-21swapper/222:40:142
2523789251,2sleep20-21swapper/222:35:172
2521102250,1sleep00-21swapper/022:34:560
2508032250,1sleep20-21swapper/222:22:072
2485534250,2sleep02487755-21cut22:05:190
2482861250,1sleep20-21swapper/222:05:132
2482275250,1sleep00-21swapper/022:00:460
2476425250,2sleep20-21swapper/222:00:112
2470002250,2sleep22469966-21/usr/sbin/munin21:55:112
2469403250,1sleep20-21swapper/221:51:032
2464144251,2sleep00-21swapper/021:50:170
2443679250,1sleep00-21swapper/021:34:210
2430253250,3sleep02424726-21/usr/sbin/munin21:20:230
2420088251,2sleep00-21swapper/021:15:180
2417733250,1sleep00-21swapper/021:11:310
2406956251,2sleep22408988-21kthreadcore21:05:182
2385082250,2sleep22385126-21ps20:45:232
2373356250,2sleep20-21swapper/220:40:112
2347702250,2sleep20-21swapper/220:20:122
2340808250,1sleep00-21swapper/020:12:450
2340659250,1sleep20-21swapper/220:10:502
2334392250,1sleep00-21swapper/020:07:590
2307992250,3sleep22308082-21readlink19:45:222
2302306250,1sleep00-21swapper/019:43:440
2289214250,1sleep00-21swapper/019:33:390
2282714250,1sleep20-21swapper/219:27:162
2269952250,1sleep00-21swapper/019:18:200
2665082240,2sleep00-21swapper/000:25:170
2661894240,2sleep00-21swapper/000:20:200
2649632240,3sleep00-21swapper/000:11:390
2637277240,1sleep20-21swapper/200:05:122
2619424240,2sleep02619461-21kthreadcore23:50:160
2617703240,3sleep00-21swapper/023:49:510
2593000240,2sleep20-21swapper/223:30:142
2578877240,3sleep20-21swapper/223:19:282
2573539240,2sleep00-21swapper/023:15:140
2572260240,1sleep20-21swapper/223:11:352
2558894240,1sleep20-21swapper/223:00:212
2534235240,1sleep20-21swapper/222:45:122
2527820240,3sleep00-21swapper/022:40:080
2514001240,1sleep00-21swapper/022:25:210
2501464240,3sleep20-21swapper/222:15:272
2458603240,2sleep22460674-21kthreadcore21:45:172
2451926240,1sleep20-21swapper/221:40:162
2444259240,1sleep20-21swapper/221:35:122
2433366240,2sleep20-21swapper/221:25:192
2373548241,1sleep00-21swapper/020:40:120
2366922240,1sleep00-21swapper/020:35:120
2323457241,1sleep2421rcuc/220:00:162
2318326240,2sleep00-21swapper/019:55:180
2314523240,1sleep20-21swapper/219:50:232
2308793240,2sleep00-21swapper/019:49:320
2278227241,1sleep00-21swapper/019:25:170
2675326230,1sleep20-21swapper/200:32:052
2662998230,1sleep20-21swapper/200:25:122
2608791230,1sleep00-21swapper/023:40:180
2598519230,1sleep00-21swapper/023:35:140
2585492230,1sleep20-21swapper/223:25:012
2560149230,1sleep20-21swapper/223:05:152
2551955230,1sleep00-21swapper/022:55:190
2551955230,1sleep00-21swapper/022:55:180
2495059230,1sleep20-21swapper/222:10:332
2450903230,1sleep00-21swapper/021:40:150
2402127230,1sleep20-21swapper/221:00:182
2386369230,2sleep00-21swapper/020:50:140
2366373230,1sleep20-21swapper/220:31:182
2366373230,1sleep20-21swapper/220:31:172
2353682230,1sleep00-21swapper/020:23:030
2327063230,1sleep00-21swapper/020:00:180
2379639220,1sleep00-21swapper/020:45:020
2289567220,1sleep20-21swapper/219:35:042
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional