# Difference between nci-files-report and du

**URL:** <https://forum.access-hive.org.au/t/difference-between-nci-files-report-and-du/4429>\
**Category:** Technical\
**Created:** [22 April 2025 23:06 UTC](https://forum.access-hive.org.au/t/difference-between-nci-files-report-and-du/4429 "2025-04-22T23:06:00Z")\
**Posts on this page:** 11\
**Page:** 1

<div class="post-metadata">

**Author:** ![chenhui.jin](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.access-hive.org.au/chenhui.jin/32/2550_2.png) [@chenhui.jin](https://forum.access-hive.org.au/u/chenhui.jin)\
**Post date:** [22 April 2025 23:06 UTC](https://forum.access-hive.org.au/t/difference-between-nci-files-report-and-du/4429/1 "2025-04-22T23:06:00Z")

</div>

Hi team,

I am managing my storage usage on Gadi, and I find a big difference between `nci-files-report` and `du`:

`nci-files-report --project if69 --filesystem gdata --sort-by total_size` gives a space usage of 170.7 G  
 ![Screenshot 2025-04-23 at 8.54.09 am](https://us1.discourse-cdn.com/flex020/uploads/access1/optimized/2X/0/04ebba2bef510b528902df0705d9d3b76151bcee_2_690x16.png)

However, I went to my directory under the project and run `du -sch /g/data/if69/cj0591`. It only returns 50 G  
 ![Screenshot 2025-04-23 at 8.58.09 am](https://us1.discourse-cdn.com/flex020/uploads/access1/original/2X/b/b0eed3ad9d6596739b4378cbcd2a17ae124a0ec4.png)

I understand that `du` only calculates the data in the directory, but it doesn’t take into account data that could be physically in a different directory but from the same user and belongs to the same project.

Can anyone suggest how I can find the extra 120.5 G that could be in other directories?

Thanks in advance,  
Chenhui

---

<div class="post-metadata">

**Author:** ![Aidan](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.access-hive.org.au/aidan/32/42_2.png) [@Aidan](https://forum.access-hive.org.au/u/Aidan)\
**Post date:** [23 April 2025 02:13 UTC](https://forum.access-hive.org.au/t/difference-between-nci-files-report-and-du/4429/2 "2025-04-23T02:13:48Z")

</div>

> [@chenhui.jin](#):
>
> Can anyone suggest how I can find the extra 120.5 G that could be in other directories?

The `--group` flag will show usage in other project directories:

```bash
nci-files-report --group if69 --filesystem gdata --sort-by total_size

```

but I don’t think that is the problem here, as they wouldn’t be reported as project and group `if69`.

You could try

```auto
find /g/data/if69 --user cj0591 -not -path "/g/data/cj0591/*

```

to see if there are files you own in another location.

---

<div class="post-metadata">

**Author:** ![chenhui.jin](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.access-hive.org.au/chenhui.jin/32/2550_2.png) [@chenhui.jin](https://forum.access-hive.org.au/u/chenhui.jin)\
**Post date:** [23 April 2025 03:07 UTC](https://forum.access-hive.org.au/t/difference-between-nci-files-report-and-du/4429/3 "2025-04-23T03:07:53Z")

</div>

Hi Aidan,

Thanks for your prompt reply.

I try `find /g/data/if69 -user cj0591 -not -path "/g/data/cj0591/*"`

Some data that is under `/g/data/if69/.Trash-17286` and belongs to my username `cj0591`:

 ![scrs_2](https://us1.discourse-cdn.com/flex020/uploads/access1/original/2X/6/6b09b769438e34c761c4e98e2f350e2107c3283e.png)

I use `du -sh *`, which shows:

 ![scrs_1](https://us1.discourse-cdn.com/flex020/uploads/access1/original/2X/9/90b159ff2035294dcaabbfddc63342c2d5099b23.png)

[![](https://us1.discourse-cdn.com/flex020/uploads/access1/original/2X/9/90b159ff2035294dcaabbfddc63342c2d5099b23.png) ](https://us1.discourse-cdn.com/flex020/uploads/access1/original/2X/9/90b159ff2035294dcaabbfddc63342c2d5099b23.png)

The total size is 122 GB, which explains the gap. What are those files? Is Ok to remove this data?

---

<div class="post-metadata">

**Author:** ![Aidan](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.access-hive.org.au/aidan/32/42_2.png) [@Aidan](https://forum.access-hive.org.au/u/Aidan)\
**Post date:** [23 April 2025 03:42 UTC](https://forum.access-hive.org.au/t/difference-between-nci-files-report-and-du/4429/4 "2025-04-23T03:42:37Z")

</div>

> [@chenhui.jin](#):
>
> What are those files? Is Ok to remove this data?

I think I’ve seen this before. Do you use ARE? In the past dragging files to the trash/recycle bin on ARE doesn’t actually delete them, but puts them in a hidden folder. This might be similar for you.

You can look into the directory to confirm you don’t need the files anymore, and then delete if appropriate.

---

<div class="post-metadata">

**Author:** ![chenhui.jin](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.access-hive.org.au/chenhui.jin/32/2550_2.png) [@chenhui.jin](https://forum.access-hive.org.au/u/chenhui.jin)\
**Post date:** [23 April 2025 03:47 UTC](https://forum.access-hive.org.au/t/difference-between-nci-files-report-and-du/4429/5 "2025-04-23T03:47:16Z")

</div>

Thanks! I will delete the files that I don’t need.

---

<div class="post-metadata">

**Author:** ![griff](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.access-hive.org.au/griff/32/332_2.png) [@griff](https://forum.access-hive.org.au/u/griff)\
**Post date:** [23 April 2025 04:49 UTC](https://forum.access-hive.org.au/t/difference-between-nci-files-report-and-du/4429/6 "2025-04-23T04:49:40Z")

</div>

Apologies for tagging on the end of this chat. I manage `dx2` and there are many reasons I have found for mismatches in the reporting. Is it worthwhile listing these for future players? I am guessing a Project Administration FAQ. I have already shared a few of these ‘tips and tricks’ with colleagues that are taking on the management of other projects. Arguably the potential audience might already be across the issues.

---

<div class="post-metadata">

**Author:** ![Aidan](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.access-hive.org.au/aidan/32/42_2.png) [@Aidan](https://forum.access-hive.org.au/u/Aidan)\
**Post date:** [23 April 2025 06:34 UTC](https://forum.access-hive.org.au/t/difference-between-nci-files-report-and-du/4429/7 "2025-04-23T06:34:39Z")

</div>

> [@griff](#):
>
> Apologies for tagging on the end of this chat. I manage `dx2` and there are many reasons I have found for mismatches in the reporting. Is it worthwhile listing these for future players? I am guessing a Project Administration FAQ

If you’d like to start a topic about this I am sure it would be welcome.

---

<div class="post-metadata">

**Author:** ![navidcy](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.access-hive.org.au/navidcy/32/101_2.png) [@navidcy](https://forum.access-hive.org.au/u/navidcy)\
**Post date:** [23 April 2025 22:21 UTC](https://forum.access-hive.org.au/t/difference-between-nci-files-report-and-du/4429/8 "2025-04-23T22:21:12Z")

</div>

Yes, I +1 that! Start a thread/topic; it’s a great idea.  
A few of us could gather information there! @griff, please tag me if you do!

---

<div class="post-metadata">

**Author:** ![navidcy](https://sea2.discourse-cdn.com/flex020/user_avatar/forum.access-hive.org.au/navidcy/32/101_2.png) [@navidcy](https://forum.access-hive.org.au/u/navidcy)\
**Post date:** [23 April 2025 22:21 UTC](https://forum.access-hive.org.au/t/difference-between-nci-files-report-and-du/4429/9 "2025-04-23T22:21:59Z")

</div>

Thanks for this @Aidan! I didn’t know about the `.Trash` directories!

---

<div class="post-metadata">

**Author:** ![ZhangchengPei](https://avatars.discourse-cdn.com/v4/letter/z/8e8cbc/32.png) [@ZhangchengPei](https://forum.access-hive.org.au/u/ZhangchengPei)\
**Post date:** [12 March 2026 02:49 UTC](https://forum.access-hive.org.au/t/difference-between-nci-files-report-and-du/4429/10 "2026-03-12T02:49:13Z")

</div>

Hi everyone,  
I’m seeing a discrepancy between `nci-files-report` and `du` for project jk72 again. I attempted to manually clear out my `.Trash` folder to resolve the storage overhead, but I’m receiving a “Permission Denied” error when trying to `cd` into it.

Has there been a recent change to permissions for the `.Trash` directory? If I need elevated access to manage this, should I reach out to my project’s Lead CI, or is this something NCI support needs to handle?

Cheers,  
Zhangcheng

---

<div class="post-metadata">

**Author:** ![ZhangchengPei](https://avatars.discourse-cdn.com/v4/letter/z/8e8cbc/32.png) [@ZhangchengPei](https://forum.access-hive.org.au/u/ZhangchengPei)\
**Post date:** [12 March 2026 03:17 UTC](https://forum.access-hive.org.au/t/difference-between-nci-files-report-and-du/4429/11 "2026-03-12T03:17:08Z")

</div>

Please disregard my previous message. It turns out I was inadvertently attempting to access a `.Trash` directory that didn’t belong to me. I’ve navigated to the correct path now. Sorry for any confusion!
